2024-01-27T14:14:14.851 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-27T14:14:14.852 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --name yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/orig.config.yaml 2024-01-27T14:14:14.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T14:14:14.978 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7534528' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4613 sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu/zqIZRBFg3jp2A+Ufv+qjoMhSjPz03v7LvvtAVKnmEO2mjp7B1iuDNtezGLOzuLi6c/O9wg94epW1vuIk0f8= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdEBJQmefarsjgSOccQldjMza8K92XAI0BWDP44GlKV+4iAQNyG015M92vcgO5zbF4gOApWiYROHiqIfxZy17w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-26_15:05:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-27T14:14:14.978 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa; will attempt to use it 2024-01-27T14:14:14.979 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks 2024-01-27T14:14:14.979 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-27T14:14:14.980 INFO:teuthology.task.internal:Checking packages... 2024-01-27T14:14:15.005 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f' 2024-01-27T14:14:15.005 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-27T14:14:15.005 INFO:teuthology.packaging:ref: None 2024-01-27T14:14:15.005 INFO:teuthology.packaging:tag: None 2024-01-27T14:14:15.005 INFO:teuthology.packaging:branch: main 2024-01-27T14:14:15.005 INFO:teuthology.packaging:sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:14:15.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-01-27T14:14:15.299 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-918.g37d5d931 2024-01-27T14:14:15.300 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-27T14:14:15.307 INFO:teuthology.task.internal:no buildpackages task found 2024-01-27T14:14:15.308 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-27T14:14:15.347 INFO:teuthology.task.internal:Saving configuration 2024-01-27T14:14:15.364 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-27T14:14:15.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T14:14:15.399 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:09:19.252140', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu/zqIZRBFg3jp2A+Ufv+qjoMhSjPz03v7LvvtAVKnmEO2mjp7B1iuDNtezGLOzuLi6c/O9wg94epW1vuIk0f8='} 2024-01-27T14:14:15.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:09:19.250730', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdEBJQmefarsjgSOccQldjMza8K92XAI0BWDP44GlKV+4iAQNyG015M92vcgO5zbF4gOApWiYROHiqIfxZy17w='} 2024-01-27T14:14:15.419 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-27T14:14:15.426 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-27T14:14:15.426 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-27T14:14:15.426 INFO:teuthology.run_tasks:Running task console_log... 2024-01-27T14:14:15.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3f858d3430>, signals=[15]) 2024-01-27T14:14:15.501 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-27T14:14:15.508 INFO:teuthology.task.internal:Opening connections... 2024-01-27T14:14:15.509 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:14:15.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:14:15.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:14:15.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:14:15.705 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-27T14:14:15.712 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-01-27T14:14:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-01-27T14:14:15.731 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-01-27T14:14:15.788 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-27T14:14:15.789 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T14:14:15.789 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-01-27T14:14:15.809 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-01-27T14:14:15.826 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-01-27T14:14:15.827 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-27T14:14:15.883 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-01-27T14:14:15.884 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T14:14:15.884 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-27T14:14:15.884 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T14:14:15.884 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-01-27T14:14:15.917 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-27T14:14:15.926 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-27T14:14:15.955 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-27T14:14:15.955 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-01-27T14:14:15.958 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-01-27T14:14:15.974 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-27T14:14:15.982 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-27T14:14:15.982 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-01-27T14:14:16.016 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-01-27T14:14:16.105 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-27T14:14:16.161 INFO:teuthology.run_tasks:Running task kernel... 2024-01-27T14:14:16.177 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-27T14:14:16.177 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-27T14:14:16.177 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-27T14:14:16.177 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-27T14:14:16.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:14:16.194 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-01-27T14:14:16.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:14:16.195 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-27T14:14:16.251 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-361.el9.x86_64 2024-01-27T14:14:16.251 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-361.el9.x86_64 2024-01-27T14:14:16.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-01-27T14:14:16.253 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-01-27T14:14:16.253 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-361.el9.x86_64 2024-01-27T14:14:16.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-01-27T14:14:18.529 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2024-01-27T14:14:18.728 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.4 MB 00:00 2024-01-27T14:14:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-01-27T14:14:20.329 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 2.7 MB/s | 2.0 MB 00:00 2024-01-27T14:14:20.902 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.0 MB 00:00 2024-01-27T14:14:22.055 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-01-27T14:14:23.938 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-01-27T14:14:24.120 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 19 MB 00:02 2024-01-27T14:14:28.799 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.9 MB 00:01 2024-01-27T14:14:29.395 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.9 MB 00:01 2024-01-27T14:14:30.322 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-01-27T14:14:30.954 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2024-01-27T14:14:32.301 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-01-27T14:14:32.472 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-01-27T14:14:37.157 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-01-27T14:14:37.689 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-01-27T14:14:39.455 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-27T14:14:39.455 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-27T14:14:39.547 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-01-27T14:14:39.553 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-01-27T14:14:39.553 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-01-27T14:14:39.553 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-01-27T14:14:39.553 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-01-27T14:14:39.553 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-01-27T14:14:39.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:14:39.555 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 99 M 2024-01-27T14:14:39.555 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 122 M 2024-01-27T14:14:39.555 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-01-27T14:14:40.000 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 13 MB/s | 6.0 MB 00:00 2024-01-27T14:14:40.054 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-27T14:14:40.054 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-27T14:14:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-01-27T14:14:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T14:14:40.159 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-01-27T14:14:40.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:14:40.159 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 99 M 2024-01-27T14:14:40.159 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 122 M 2024-01-27T14:14:40.159 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-01-27T14:14:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 8.8 MB/s | 6.0 MB 00:00 2024-01-27T14:14:40.892 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 16 MB/s | 21 MB 00:01 2024-01-27T14:14:41.890 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 12 MB/s | 21 MB 00:01 2024-01-27T14:14:42.158 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 15 MB/s | 39 MB 00:02 2024-01-27T14:14:42.441 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 17 MB/s | 39 MB 00:02 2024-01-27T14:14:42.658 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 13 MB/s | 33 MB 00:02 2024-01-27T14:14:42.661 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-01-27T14:14:42.661 INFO:teuthology.orchestra.run.smithi073.stdout:Total 32 MB/s | 99 MB 00:03 2024-01-27T14:14:42.662 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-01-27T14:14:42.799 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 17 MB/s | 33 MB 00:01 2024-01-27T14:14:42.803 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-01-27T14:14:42.803 INFO:teuthology.orchestra.run.smithi046.stdout:Total 38 MB/s | 99 MB 00:02 2024-01-27T14:14:42.803 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-01-27T14:14:43.035 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-01-27T14:14:43.035 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-01-27T14:14:43.213 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-01-27T14:14:43.213 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-01-27T14:14:44.030 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-01-27T14:14:44.030 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-01-27T14:14:44.245 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-01-27T14:14:44.245 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-01-27T14:14:46.433 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-01-27T14:14:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-01-27T14:14:47.285 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-27T14:14:47.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:14:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-27T14:14:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:14:50.167 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:14:50.352 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:14:50.538 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:14:50.716 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:14:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:14:55.255 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:14:55.769 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:14:55.863 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:14:59.970 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:00.947 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:28.921 INFO:teuthology.orchestra.run.smithi073.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-27T14:15:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:15:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:29.378 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:29.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-27T14:15:29.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:15:29.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-27T14:15:29.802 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-27T14:15:29.803 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-27T14:15:29.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:15:29.803 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-01-27T14:15:30.309 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T14:15:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:30.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T14:15:30.464 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-27T14:15:30.464 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-27T14:15:30.464 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-27T14:15:30.464 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-27T14:15:30.465 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-01-27T14:15:30.465 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T14:15:30.571 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:30.572 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T14:15:30.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-01-27T14:15:30.611 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-01-27T14:15:30.611 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-27T14:15:30.612 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:15:30.613 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-01-27T14:15:30.614 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-27T14:15:30.614 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-411.el9.x86_64 2024-01-27T14:15:30.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-27T14:15:31.216 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-01-27T14:15:31.665 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:31.665 INFO:teuthology.orchestra.run.smithi046.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-27T14:15:31.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:15:31.736 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:32.200 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:32.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-27T14:15:32.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T14:15:32.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T14:15:32.586 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T14:15:32.586 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:15:32.587 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-01-27T14:15:32.707 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-27T14:15:32.742 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-01-27T14:15:32.744 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-01-27T14:15:32.759 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.DfnpwQjYZl 2024-01-27T14:15:32.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DfnpwQjYZl 2024-01-27T14:15:32.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.DfnpwQjYZl 2024-01-27T14:15:32.973 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.DfnpwQjYZl is 6KB 2024-01-27T14:15:33.024 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.DfnpwQjYZl 2024-01-27T14:15:33.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-01-27T14:15:33.106 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T14:15:33.108 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-27T14:15:33.108 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-27T14:15:33.108 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-27T14:15:33.108 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-27T14:15:33.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-27T14:15:33.250 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:33.250 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T14:15:33.250 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-27T14:15:33.250 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-27T14:15:33.250 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-27T14:15:33.250 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-27T14:15:33.250 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-01-27T14:15:33.250 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T14:15:33.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-01-27T14:15:33.362 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T14:15:33.363 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T14:15:33.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-27T14:15:33.401 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-27T14:15:33.402 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-27T14:15:33.403 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-01-27T14:15:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:15:33.403 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-01-27T14:15:33.403 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-27T14:15:33.403 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-411.el9.x86_64 2024-01-27T14:15:33.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-27T14:15:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-01-27T14:15:35.541 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18078: grub2-probe 2024-01-27T14:15:35.541 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18078: grub2-probe 2024-01-27T14:15:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18078: grub2-probe 2024-01-27T14:15:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18078: grub2-probe 2024-01-27T14:15:35.732 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18126: grub2-probe 2024-01-27T14:15:35.733 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18126: grub2-probe 2024-01-27T14:15:35.774 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18126: grub2-probe 2024-01-27T14:15:35.774 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18126: grub2-probe 2024-01-27T14:15:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18174: grub2-probe 2024-01-27T14:15:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18174: grub2-probe 2024-01-27T14:15:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18174: grub2-probe 2024-01-27T14:15:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18174: grub2-probe 2024-01-27T14:15:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18222: grub2-probe 2024-01-27T14:15:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18222: grub2-probe 2024-01-27T14:15:36.167 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18222: grub2-probe 2024-01-27T14:15:36.167 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18222: grub2-probe 2024-01-27T14:15:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18270: grub2-probe 2024-01-27T14:15:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18270: grub2-probe 2024-01-27T14:15:36.321 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30546]) leaked on vgs invocation. Parent PID 18270: grub2-probe 2024-01-27T14:15:36.321 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[36528]) leaked on vgs invocation. Parent PID 18270: grub2-probe 2024-01-27T14:15:36.510 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-27T14:15:36.525 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-01-27T14:15:36.534 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-27T14:15:36.549 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.bglsaxSTrq 2024-01-27T14:15:36.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bglsaxSTrq 2024-01-27T14:15:36.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.bglsaxSTrq 2024-01-27T14:15:36.766 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.bglsaxSTrq is 6KB 2024-01-27T14:15:36.816 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.bglsaxSTrq 2024-01-27T14:15:36.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-01-27T14:15:36.907 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-27T14:15:36.907 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-27T14:15:36.907 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-27T14:15:36.907 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-27T14:15:36.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-27T14:15:37.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-01-27T14:16:03.304 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-27T14:16:03.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:16:03.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:16:07.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-27T14:16:07.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:16:07.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:16:21.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-01-27T14:16:25.404 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-27T14:16:30.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:16:30.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:16:34.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:16:34.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:16:37.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-27T14:16:49.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:16:49.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:17:07.900 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-27T14:17:22.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:17:22.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:17:23.528 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-27T14:17:23.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:17:23.929 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-411.el9.x86_64"... 2024-01-27T14:17:23.930 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-27T14:17:23.944 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-411.el9.x86_64 2024-01-27T14:17:23.944 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-27T14:17:23.944 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-27T14:17:23.944 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-27T14:17:24.946 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-27T14:17:24.946 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-27T14:17:25.006 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-01-27T14:17:25.050 DEBUG:teuthology.parallel:result is None 2024-01-27T14:17:30.827 DEBUG:teuthology.orchestra.remote:timed out 2024-01-27T14:17:42.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:17:42.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:17:43.512 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-01-27T14:17:43.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:17:43.927 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-411.el9.x86_64"... 2024-01-27T14:17:43.927 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-01-27T14:17:43.943 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-411.el9.x86_64 2024-01-27T14:17:43.943 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-27T14:17:43.943 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-27T14:17:43.943 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-27T14:17:44.943 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-27T14:17:44.944 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-27T14:17:45.025 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-01-27T14:17:45.051 DEBUG:teuthology.parallel:result is None 2024-01-27T14:17:45.051 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-27T14:17:45.060 INFO:teuthology.task.internal:Creating test directory... 2024-01-27T14:17:45.060 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-27T14:17:45.064 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-27T14:17:45.081 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-27T14:17:45.088 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-27T14:17:45.097 INFO:teuthology.task.internal:Creating archive directory... 2024-01-27T14:17:45.098 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-27T14:17:45.122 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-27T14:17:45.151 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-27T14:17:45.158 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-27T14:17:45.158 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-27T14:17:45.187 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-27T14:17:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T14:17:45.221 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T14:17:45.232 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T14:17:45.234 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T14:17:45.236 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-27T14:17:45.243 INFO:teuthology.task.internal:Configuring sudo... 2024-01-27T14:17:45.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-27T14:17:45.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-27T14:17:45.307 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-27T14:17:45.316 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-27T14:17:45.316 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-27T14:17:45.348 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-27T14:17:45.364 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T14:17:45.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T14:17:45.494 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T14:17:45.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T14:17:45.620 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:17:45.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-27T14:17:45.688 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T14:17:45.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T14:17:45.795 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T14:17:45.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T14:17:45.883 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:17:45.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-27T14:17:45.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-01-27T14:17:45.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-01-27T14:17:46.011 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T14:17:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T14:17:46.290 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-27T14:17:46.298 INFO:teuthology.task.internal:Starting timer... 2024-01-27T14:17:46.299 INFO:teuthology.run_tasks:Running task pcp... 2024-01-27T14:17:46.313 INFO:teuthology.run_tasks:Running task selinux... 2024-01-27T14:17:46.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-01-27T14:17:46.383 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-01-27T14:17:46.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-01-27T14:17:46.434 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-01-27T14:17:46.436 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-27T14:17:46.436 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-01-27T14:17:46.463 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-01-27T14:17:46.463 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-01-27T14:17:46.483 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-01-27T14:17:46.483 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-01-27T14:17:46.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T14:17:46.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:17:46.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T14:17:46.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:17:46.562 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-27T14:17:46.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-01-27T14:17:46.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-01-27T14:17:46.651 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-27T14:17:46.661 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-27T14:17:46.667 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-27T14:17:46.782 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-27T14:17:46.801 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-27T14:17:46.804 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-27T14:21:59.948 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-01-27T14:21:59.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:21:59.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:22:00.043 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-27T14:22:00.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T14:22:00.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:22:00.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T14:22:00.216 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-01-27T14:22:00.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-27T14:22:00.290 INFO:teuthology.run_tasks:Running task clock... 2024-01-27T14:22:00.302 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-27T14:22:00.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-27T14:22:00.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T14:22:00.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-27T14:22:00.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T14:22:00.334 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-27T14:22:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-27T14:22:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-27T14:22:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-27T14:22:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-01-27T14:22:00.394 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-01-27T14:22:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-01-27T14:22:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-27T14:22:00.419 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-01-27T14:22:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-27T14:22:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-27T14:22:00.451 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-27T14:22:00.478 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-01-27T14:22:00.481 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T14:22:00.482 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-01-27T14:22:00.482 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.482 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.482 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.482 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.506 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:22:00.507 INFO:teuthology.run_tasks:Running task install... 2024-01-27T14:22:00.515 DEBUG:teuthology.task.install:project ceph 2024-01-27T14:22:00.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}} 2024-01-27T14:22:00.516 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'} 2024-01-27T14:22:00.516 INFO:teuthology.task.install:Using flavor: default 2024-01-27T14:22:00.522 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-27T14:22:00.522 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-27T14:22:00.522 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'tag': None, 'wait_for_package': False} 2024-01-27T14:22:00.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:22:00.525 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'tag': None, 'wait_for_package': False} 2024-01-27T14:22:00.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:22:00.675 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/ 2024-01-27T14:22:00.675 INFO:teuthology.task.install.rpm:Package version is 19.0.0-880.g99a21c3b 2024-01-27T14:22:00.746 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/ 2024-01-27T14:22:00.746 INFO:teuthology.task.install.rpm:Package version is 19.0.0-880.g99a21c3b 2024-01-27T14:22:00.783 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-27T14:22:00.783 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:22:00.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-27T14:22:00.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-27T14:22:00.811 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-27T14:22:00.856 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-27T14:22:00.857 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:22:00.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-27T14:22:00.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-27T14:22:00.885 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-27T14:22:00.886 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-27T14:22:00.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-27T14:22:00.959 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-27T14:22:01.025 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-01-27T14:22:01.027 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-01-27T14:22:01.034 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-27T14:22:01.100 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-01-27T14:22:01.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-01-27T14:22:01.272 INFO:teuthology.orchestra.run.smithi073.stdout:74 files removed 2024-01-27T14:22:01.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-27T14:22:01.346 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-01-27T14:22:01.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-27T14:22:02.092 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 168 kB/s | 80 kB 00:00 2024-01-27T14:22:02.163 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 171 kB/s | 80 kB 00:00 2024-01-27T14:22:02.493 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 27 kB/s | 9.5 kB 00:00 2024-01-27T14:22:02.589 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2024-01-27T14:22:02.844 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-01-27T14:22:02.964 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-01-27T14:22:03.254 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2024-01-27T14:22:03.492 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2024-01-27T14:22:04.621 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-01-27T14:22:05.075 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-01-27T14:22:05.720 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-01-27T14:22:06.383 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.0 MB 00:00 2024-01-27T14:22:08.234 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-01-27T14:22:11.346 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 19 MB 00:04 2024-01-27T14:22:12.685 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 5.9 MB 00:00 2024-01-27T14:22:14.169 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 15 kB 00:00 2024-01-27T14:22:16.131 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-01-27T14:22:16.725 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.9 MB 00:01 2024-01-27T14:22:18.056 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 15 kB 00:00 2024-01-27T14:22:19.116 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2024-01-27T14:22:21.213 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-01-27T14:22:23.911 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T14:22:23.912 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T14:22:23.949 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-27T14:22:23.950 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-27T14:22:23.951 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-27T14:22:23.952 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-27T14:22:23.954 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-27T14:22:23.957 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-27T14:22:23.958 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-27T14:22:24.045 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 6.5 k 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.1 M 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 67 M 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 411 M 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 885 k 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.9 M 2024-01-27T14:22:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 145 k 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.4 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 48 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.5 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 133 k 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 1.7 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 20 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 7.4 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 52 k 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 286 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 8.7 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 46 M 2024-01-27T14:22:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 664 M 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 262 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 742 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 217 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 27 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 18 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 31 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 741 k 2024-01-27T14:22:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.3 M 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 127 k 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 109 k 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 44 M 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-27T14:22:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 162 k 2024-01-27T14:22:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 615 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 321 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 771 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 298 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.1 M 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 337 k 2024-01-27T14:22:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 85 k 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 509 k 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 k 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.3 M 2024-01-27T14:22:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-27T14:22:24.072 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-01-27T14:22:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-27T14:22:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-27T14:22:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-27T14:22:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-27T14:22:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.4 M 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-27T14:22:24.074 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 19 M 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 22 M 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 28 k 2024-01-27T14:22:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 2.1 M 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 245 k 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.7 M 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 17 M 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 15 k 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 25 k 2024-01-27T14:22:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-27T14:22:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 163 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-27T14:22:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 499 k 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.8 M 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-27T14:22:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-27T14:22:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-27T14:22:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 45 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 130 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-27T14:22:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-27T14:22:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-27T14:22:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-27T14:22:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-27T14:22:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-27T14:22:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-27T14:22:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-27T14:22:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-27T14:22:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout:Install 161 Packages 2024-01-27T14:22:24.091 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 16 Packages 2024-01-27T14:22:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:22:24.092 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.1 G 2024-01-27T14:22:24.093 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-01-27T14:22:24.158 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-01-27T14:22:25.114 INFO:teuthology.orchestra.run.smithi046.stdout:(1/177): ceph-19.0.0-880.g99a21c3b.el9.x86_64.r 16 kB/s | 6.5 kB 00:00 2024-01-27T14:22:26.811 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T14:22:26.812 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T14:22:26.840 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-27T14:22:26.841 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-27T14:22:26.842 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-27T14:22:26.843 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-27T14:22:26.845 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-27T14:22:26.847 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-27T14:22:26.848 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-27T14:22:26.926 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-01-27T14:22:26.938 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================== 2024-01-27T14:22:26.938 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================== 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 6.5 k 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.1 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 67 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 411 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 885 k 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.9 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 145 k 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.4 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 48 M 2024-01-27T14:22:26.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.5 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 133 k 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 1.7 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 20 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 7.4 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 52 k 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 286 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 8.7 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 46 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 664 M 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 262 k 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 742 k 2024-01-27T14:22:26.940 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 217 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 27 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 18 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 31 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 741 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.3 M 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 127 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 109 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 44 M 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-27T14:22:26.941 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 162 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 615 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 321 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 771 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 298 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.1 M 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 337 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 85 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 509 k 2024-01-27T14:22:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 k 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.3 M 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-27T14:22:26.943 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.4 M 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-27T14:22:26.944 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 19 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 22 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 28 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 2.1 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 245 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.7 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 17 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 15 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 25 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-27T14:22:26.945 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 163 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 499 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.8 M 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-27T14:22:26.946 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 45 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 130 k 2024-01-27T14:22:26.947 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-27T14:22:26.948 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-27T14:22:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-27T14:22:26.950 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-27T14:22:26.951 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:=================================================================================================== 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:Install 161 Packages 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 16 Packages 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.1 G 2024-01-27T14:22:26.952 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-01-27T14:22:28.109 INFO:teuthology.orchestra.run.smithi073.stdout:(1/177): ceph-19.0.0-880.g99a21c3b.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2024-01-27T14:22:28.847 INFO:teuthology.orchestra.run.smithi046.stdout:(2/177): ceph-base-19.0.0-880.g99a21c3b.el9.x86 1.2 MB/s | 5.1 MB 00:04 2024-01-27T14:22:30.059 INFO:teuthology.orchestra.run.smithi073.stdout:(2/177): ceph-base-19.0.0-880.g99a21c3b.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-01-27T14:22:37.489 INFO:teuthology.orchestra.run.smithi046.stdout:(3/177): ceph-common-19.0.0-880.g99a21c3b.el9.x 1.6 MB/s | 19 MB 00:12 2024-01-27T14:22:40.651 INFO:teuthology.orchestra.run.smithi073.stdout:(3/177): ceph-common-19.0.0-880.g99a21c3b.el9.x 1.5 MB/s | 19 MB 00:12 2024-01-27T14:22:42.747 INFO:teuthology.orchestra.run.smithi046.stdout:(4/177): ceph-debuginfo-19.0.0-880.g99a21c3b.el 4.2 MB/s | 22 MB 00:05 2024-01-27T14:22:43.122 INFO:teuthology.orchestra.run.smithi046.stdout:(5/177): ceph-fuse-19.0.0-880.g99a21c3b.el9.x86 2.3 MB/s | 885 kB 00:00 2024-01-27T14:22:44.572 INFO:teuthology.orchestra.run.smithi046.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-880.g99a21c 4.1 MB/s | 5.9 MB 00:01 2024-01-27T14:22:44.681 INFO:teuthology.orchestra.run.smithi046.stdout:(7/177): ceph-immutable-object-cache-19.0.0-880 1.3 MB/s | 145 kB 00:00 2024-01-27T14:22:45.056 INFO:teuthology.orchestra.run.smithi046.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 3.8 MB/s | 1.4 MB 00:00 2024-01-27T14:22:45.681 INFO:teuthology.orchestra.run.smithi046.stdout:(9/177): ceph-mds-19.0.0-880.g99a21c3b.el9.x86_ 3.4 MB/s | 2.1 MB 00:00 2024-01-27T14:22:47.808 INFO:teuthology.orchestra.run.smithi073.stdout:(4/177): ceph-debuginfo-19.0.0-880.g99a21c3b.el 3.1 MB/s | 22 MB 00:07 2024-01-27T14:22:48.217 INFO:teuthology.orchestra.run.smithi073.stdout:(5/177): ceph-fuse-19.0.0-880.g99a21c3b.el9.x86 2.1 MB/s | 885 kB 00:00 2024-01-27T14:22:50.576 INFO:teuthology.orchestra.run.smithi073.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-880.g99a21c 2.5 MB/s | 5.9 MB 00:02 2024-01-27T14:22:50.701 INFO:teuthology.orchestra.run.smithi073.stdout:(7/177): ceph-immutable-object-cache-19.0.0-880 1.1 MB/s | 145 kB 00:00 2024-01-27T14:22:51.368 INFO:teuthology.orchestra.run.smithi073.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 2.1 MB/s | 1.4 MB 00:00 2024-01-27T14:22:52.201 INFO:teuthology.orchestra.run.smithi073.stdout:(9/177): ceph-mds-19.0.0-880.g99a21c3b.el9.x86_ 2.5 MB/s | 2.1 MB 00:00 2024-01-27T14:23:01.415 INFO:teuthology.orchestra.run.smithi046.stdout:(10/177): ceph-mds-debuginfo-19.0.0-880.g99a21c 3.0 MB/s | 48 MB 00:15 2024-01-27T14:23:01.973 INFO:teuthology.orchestra.run.smithi046.stdout:(11/177): ceph-mgr-19.0.0-880.g99a21c3b.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-01-27T14:23:03.584 INFO:teuthology.orchestra.run.smithi073.stdout:(10/177): ceph-base-debuginfo-19.0.0-880.g99a21 1.9 MB/s | 67 MB 00:35 2024-01-27T14:23:04.426 INFO:teuthology.orchestra.run.smithi073.stdout:(11/177): ceph-mgr-19.0.0-880.g99a21c3b.el9.x86 1.8 MB/s | 1.5 MB 00:00 2024-01-27T14:23:04.890 INFO:teuthology.orchestra.run.smithi046.stdout:(12/177): ceph-base-debuginfo-19.0.0-880.g99a21 1.7 MB/s | 67 MB 00:40 2024-01-27T14:23:06.457 INFO:teuthology.orchestra.run.smithi046.stdout:(13/177): ceph-mon-19.0.0-880.g99a21c3b.el9.x86 3.0 MB/s | 4.7 MB 00:01 2024-01-27T14:23:07.024 INFO:teuthology.orchestra.run.smithi046.stdout:(14/177): ceph-mgr-debuginfo-19.0.0-880.g99a21c 3.9 MB/s | 20 MB 00:05 2024-01-27T14:23:11.432 INFO:teuthology.orchestra.run.smithi046.stdout:(15/177): ceph-osd-19.0.0-880.g99a21c3b.el9.x86 3.8 MB/s | 17 MB 00:04 2024-01-27T14:23:11.567 INFO:teuthology.orchestra.run.smithi073.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-880.g99a21c 2.8 MB/s | 20 MB 00:07 2024-01-27T14:23:12.592 INFO:teuthology.orchestra.run.smithi073.stdout:(13/177): ceph-mon-19.0.0-880.g99a21c3b.el9.x86 4.6 MB/s | 4.7 MB 00:01 2024-01-27T14:23:13.884 INFO:teuthology.orchestra.run.smithi073.stdout:(14/177): ceph-mds-debuginfo-19.0.0-880.g99a21c 2.2 MB/s | 48 MB 00:21 2024-01-27T14:23:19.609 INFO:teuthology.orchestra.run.smithi073.stdout:(15/177): ceph-osd-19.0.0-880.g99a21c3b.el9.x86 2.9 MB/s | 17 MB 00:05 2024-01-27T14:23:26.675 INFO:teuthology.orchestra.run.smithi073.stdout:(16/177): ceph-mon-debuginfo-19.0.0-880.g99a21c 7.0 MB/s | 99 MB 00:14 2024-01-27T14:23:28.542 INFO:teuthology.orchestra.run.smithi073.stdout:(17/177): ceph-radosgw-19.0.0-880.g99a21c3b.el9 4.6 MB/s | 8.7 MB 00:01 2024-01-27T14:23:32.642 INFO:teuthology.orchestra.run.smithi073.stdout:(18/177): ceph-common-debuginfo-19.0.0-880.g99a 6.6 MB/s | 411 MB 01:02 2024-01-27T14:23:32.709 INFO:teuthology.orchestra.run.smithi073.stdout:(19/177): ceph-selinux-19.0.0-880.g99a21c3b.el9 380 kB/s | 25 kB 00:00 2024-01-27T14:23:36.801 INFO:teuthology.orchestra.run.smithi073.stdout:(20/177): ceph-test-19.0.0-880.g99a21c3b.el9.x8 11 MB/s | 46 MB 00:04 2024-01-27T14:23:39.955 INFO:teuthology.orchestra.run.smithi046.stdout:(16/177): ceph-mon-debuginfo-19.0.0-880.g99a21c 2.9 MB/s | 99 MB 00:33 2024-01-27T14:23:41.655 INFO:teuthology.orchestra.run.smithi046.stdout:(17/177): ceph-radosgw-19.0.0-880.g99a21c3b.el9 5.1 MB/s | 8.7 MB 00:01 2024-01-27T14:24:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:(21/177): ceph-radosgw-debuginfo-19.0.0-880.g99 4.2 MB/s | 171 MB 00:41 2024-01-27T14:24:09.972 INFO:teuthology.orchestra.run.smithi073.stdout:(22/177): cephfs-mirror-19.0.0-880.g99a21c3b.el 621 kB/s | 217 kB 00:00 2024-01-27T14:24:10.081 INFO:teuthology.orchestra.run.smithi073.stdout:(23/177): cephfs-shell-19.0.0-880.g99a21c3b.el9 250 kB/s | 27 kB 00:00 2024-01-27T14:24:10.181 INFO:teuthology.orchestra.run.smithi073.stdout:(24/177): libcephfs-devel-19.0.0-880.g99a21c3b. 312 kB/s | 31 kB 00:00 2024-01-27T14:24:10.831 INFO:teuthology.orchestra.run.smithi073.stdout:(25/177): libcephfs2-19.0.0-880.g99a21c3b.el9.x 1.1 MB/s | 741 kB 00:00 2024-01-27T14:24:14.473 INFO:teuthology.orchestra.run.smithi073.stdout:(26/177): libcephfs2-debuginfo-19.0.0-880.g99a2 1.5 MB/s | 5.3 MB 00:03 2024-01-27T14:24:14.665 INFO:teuthology.orchestra.run.smithi073.stdout:(27/177): libcephsqlite-19.0.0-880.g99a21c3b.el 852 kB/s | 163 kB 00:00 2024-01-27T14:24:14.773 INFO:teuthology.orchestra.run.smithi073.stdout:(28/177): librados-devel-19.0.0-880.g99a21c3b.e 1.1 MB/s | 127 kB 00:00 2024-01-27T14:24:14.873 INFO:teuthology.orchestra.run.smithi073.stdout:(29/177): librados-devel-debuginfo-19.0.0-880.g 1.1 MB/s | 109 kB 00:00 2024-01-27T14:24:32.981 INFO:teuthology.orchestra.run.smithi073.stdout:(30/177): ceph-osd-debuginfo-19.0.0-880.g99a21c 3.9 MB/s | 286 MB 01:13 2024-01-27T14:24:33.206 INFO:teuthology.orchestra.run.smithi073.stdout:(31/177): libradosstriper1-19.0.0-880.g99a21c3b 2.2 MB/s | 499 kB 00:00 2024-01-27T14:24:33.664 INFO:teuthology.orchestra.run.smithi073.stdout:(32/177): librados2-debuginfo-19.0.0-880.g99a21 2.3 MB/s | 44 MB 00:18 2024-01-27T14:24:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:(18/177): ceph-common-debuginfo-19.0.0-880.g99a 3.3 MB/s | 411 MB 02:05 2024-01-27T14:24:34.360 INFO:teuthology.orchestra.run.smithi046.stdout:(19/177): ceph-selinux-19.0.0-880.g99a21c3b.el9 189 kB/s | 25 kB 00:00 2024-01-27T14:24:34.648 INFO:teuthology.orchestra.run.smithi073.stdout:(33/177): librgw2-19.0.0-880.g99a21c3b.el9.x86_ 4.9 MB/s | 4.8 MB 00:00 2024-01-27T14:24:34.748 INFO:teuthology.orchestra.run.smithi073.stdout:(34/177): python3-ceph-argparse-19.0.0-880.g99a 452 kB/s | 45 kB 00:00 2024-01-27T14:24:34.848 INFO:teuthology.orchestra.run.smithi073.stdout:(35/177): python3-ceph-common-19.0.0-880.g99a21 1.3 MB/s | 130 kB 00:00 2024-01-27T14:24:34.949 INFO:teuthology.orchestra.run.smithi073.stdout:(36/177): python3-cephfs-19.0.0-880.g99a21c3b.e 1.6 MB/s | 162 kB 00:00 2024-01-27T14:24:35.150 INFO:teuthology.orchestra.run.smithi073.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-880.g 3.0 MB/s | 615 kB 00:00 2024-01-27T14:24:35.257 INFO:teuthology.orchestra.run.smithi073.stdout:(38/177): python3-rados-19.0.0-880.g99a21c3b.el 2.9 MB/s | 321 kB 00:00 2024-01-27T14:24:35.516 INFO:teuthology.orchestra.run.smithi073.stdout:(39/177): python3-rados-debuginfo-19.0.0-880.g9 2.9 MB/s | 771 kB 00:00 2024-01-27T14:24:35.624 INFO:teuthology.orchestra.run.smithi073.stdout:(40/177): python3-rbd-19.0.0-880.g99a21c3b.el9. 2.7 MB/s | 298 kB 00:00 2024-01-27T14:24:35.966 INFO:teuthology.orchestra.run.smithi073.stdout:(41/177): python3-rbd-debuginfo-19.0.0-880.g99a 3.3 MB/s | 1.1 MB 00:00 2024-01-27T14:24:36.067 INFO:teuthology.orchestra.run.smithi073.stdout:(42/177): python3-rgw-19.0.0-880.g99a21c3b.el9. 995 kB/s | 99 kB 00:00 2024-01-27T14:24:36.242 INFO:teuthology.orchestra.run.smithi073.stdout:(43/177): python3-rgw-debuginfo-19.0.0-880.g99a 1.9 MB/s | 337 kB 00:00 2024-01-27T14:24:36.342 INFO:teuthology.orchestra.run.smithi073.stdout:(44/177): rbd-fuse-19.0.0-880.g99a21c3b.el9.x86 853 kB/s | 85 kB 00:00 2024-01-27T14:24:36.534 INFO:teuthology.orchestra.run.smithi073.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-880.g99a21c 2.6 MB/s | 509 kB 00:00 2024-01-27T14:24:37.376 INFO:teuthology.orchestra.run.smithi073.stdout:(46/177): rbd-mirror-19.0.0-880.g99a21c3b.el9.x 3.7 MB/s | 3.1 MB 00:00 2024-01-27T14:24:40.543 INFO:teuthology.orchestra.run.smithi046.stdout:(20/177): ceph-osd-debuginfo-19.0.0-880.g99a21c 3.2 MB/s | 286 MB 01:29 2024-01-27T14:24:43.759 INFO:teuthology.orchestra.run.smithi073.stdout:(47/177): librbd1-debuginfo-19.0.0-880.g99a21c3 4.9 MB/s | 52 MB 00:10 2024-01-27T14:24:43.851 INFO:teuthology.orchestra.run.smithi073.stdout:(48/177): rbd-nbd-19.0.0-880.g99a21c3b.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-01-27T14:24:43.960 INFO:teuthology.orchestra.run.smithi046.stdout:(21/177): ceph-radosgw-debuginfo-19.0.0-880.g99 2.7 MB/s | 171 MB 01:02 2024-01-27T14:24:44.201 INFO:teuthology.orchestra.run.smithi073.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-880.g99a21c3 3.6 MB/s | 1.3 MB 00:00 2024-01-27T14:24:44.218 INFO:teuthology.orchestra.run.smithi046.stdout:(22/177): cephfs-mirror-19.0.0-880.g99a21c3b.el 842 kB/s | 217 kB 00:00 2024-01-27T14:24:44.293 INFO:teuthology.orchestra.run.smithi073.stdout:(50/177): ceph-grafana-dashboards-19.0.0-880.g9 310 kB/s | 28 kB 00:00 2024-01-27T14:24:44.310 INFO:teuthology.orchestra.run.smithi046.stdout:(23/177): cephfs-shell-19.0.0-880.g99a21c3b.el9 295 kB/s | 27 kB 00:00 2024-01-27T14:24:44.393 INFO:teuthology.orchestra.run.smithi073.stdout:(51/177): ceph-mgr-cephadm-19.0.0-880.g99a21c3b 1.3 MB/s | 133 kB 00:00 2024-01-27T14:24:44.410 INFO:teuthology.orchestra.run.smithi046.stdout:(24/177): libcephfs-devel-19.0.0-880.g99a21c3b. 312 kB/s | 31 kB 00:00 2024-01-27T14:24:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:(25/177): libcephfs2-19.0.0-880.g99a21c3b.el9.x 2.4 MB/s | 741 kB 00:00 2024-01-27T14:24:44.910 INFO:teuthology.orchestra.run.smithi073.stdout:(52/177): ceph-mgr-dashboard-19.0.0-880.g99a21c 3.4 MB/s | 1.7 MB 00:00 2024-01-27T14:24:45.280 INFO:teuthology.orchestra.run.smithi046.stdout:(26/177): ceph-test-19.0.0-880.g99a21c3b.el9.x8 4.2 MB/s | 46 MB 00:10 2024-01-27T14:24:45.378 INFO:teuthology.orchestra.run.smithi046.stdout:(27/177): libcephsqlite-19.0.0-880.g99a21c3b.el 1.6 MB/s | 163 kB 00:00 2024-01-27T14:24:45.479 INFO:teuthology.orchestra.run.smithi046.stdout:(28/177): librados-devel-19.0.0-880.g99a21c3b.e 1.2 MB/s | 127 kB 00:00 2024-01-27T14:24:45.759 INFO:teuthology.orchestra.run.smithi046.stdout:(29/177): librados-devel-debuginfo-19.0.0-880.g 387 kB/s | 109 kB 00:00 2024-01-27T14:24:46.369 INFO:teuthology.orchestra.run.smithi073.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 5.1 MB/s | 7.4 MB 00:01 2024-01-27T14:24:46.404 INFO:teuthology.orchestra.run.smithi046.stdout:(30/177): libcephfs2-debuginfo-19.0.0-880.g99a2 3.2 MB/s | 5.3 MB 00:01 2024-01-27T14:24:46.469 INFO:teuthology.orchestra.run.smithi073.stdout:(54/177): ceph-mgr-modules-core-19.0.0-880.g99a 2.4 MB/s | 245 kB 00:00 2024-01-27T14:24:46.578 INFO:teuthology.orchestra.run.smithi073.stdout:(55/177): ceph-mgr-rook-19.0.0-880.g99a21c3b.el 480 kB/s | 52 kB 00:00 2024-01-27T14:24:46.596 INFO:teuthology.orchestra.run.smithi046.stdout:(31/177): libradosstriper1-19.0.0-880.g99a21c3b 2.5 MB/s | 499 kB 00:00 2024-01-27T14:24:46.662 INFO:teuthology.orchestra.run.smithi073.stdout:(56/177): ceph-prometheus-alerts-19.0.0-880.g99 181 kB/s | 15 kB 00:00 2024-01-27T14:24:46.770 INFO:teuthology.orchestra.run.smithi073.stdout:(57/177): ceph-volume-19.0.0-880.g99a21c3b.el9. 2.4 MB/s | 262 kB 00:00 2024-01-27T14:24:46.971 INFO:teuthology.orchestra.run.smithi073.stdout:(58/177): cephadm-19.0.0-880.g99a21c3b.el9.noar 3.6 MB/s | 742 kB 00:00 2024-01-27T14:24:47.063 INFO:teuthology.orchestra.run.smithi073.stdout:(59/177): cephfs-top-19.0.0-880.g99a21c3b.el9.n 199 kB/s | 18 kB 00:00 2024-01-27T14:24:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:(60/177): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-01-27T14:24:47.263 INFO:teuthology.orchestra.run.smithi073.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-01-27T14:24:47.297 INFO:teuthology.orchestra.run.smithi073.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-01-27T14:24:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:(63/177): elfutils-libelf-devel-0.190-2.el9.x86 614 kB/s | 20 kB 00:00 2024-01-27T14:24:47.381 INFO:teuthology.orchestra.run.smithi073.stdout:(64/177): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-01-27T14:24:47.414 INFO:teuthology.orchestra.run.smithi073.stdout:(65/177): flexiblas-3.0.4-8.el9.x86_64.rpm 953 kB/s | 32 kB 00:00 2024-01-27T14:24:47.515 INFO:teuthology.orchestra.run.smithi073.stdout:(66/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-01-27T14:24:47.548 INFO:teuthology.orchestra.run.smithi073.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 514 kB/s | 17 kB 00:00 2024-01-27T14:24:47.582 INFO:teuthology.orchestra.run.smithi073.stdout:(68/177): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-01-27T14:24:47.615 INFO:teuthology.orchestra.run.smithi073.stdout:(69/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-01-27T14:24:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:(70/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-01-27T14:24:47.699 INFO:teuthology.orchestra.run.smithi073.stdout:(71/177): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-01-27T14:24:47.750 INFO:teuthology.orchestra.run.smithi073.stdout:(72/177): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-01-27T14:24:47.775 INFO:teuthology.orchestra.run.smithi073.stdout:(73/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 988 kB/s | 24 kB 00:00 2024-01-27T14:24:47.800 INFO:teuthology.orchestra.run.smithi073.stdout:(74/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2024-01-27T14:24:47.842 INFO:teuthology.orchestra.run.smithi073.stdout:(75/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-01-27T14:24:47.884 INFO:teuthology.orchestra.run.smithi073.stdout:(76/177): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-01-27T14:24:47.909 INFO:teuthology.orchestra.run.smithi073.stdout:(77/177): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2024-01-27T14:24:48.043 INFO:teuthology.orchestra.run.smithi073.stdout:(78/177): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-01-27T14:24:48.145 INFO:teuthology.orchestra.run.smithi073.stdout:(79/177): openssl-devel-3.0.7-25.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-01-27T14:24:48.202 INFO:teuthology.orchestra.run.smithi073.stdout:(80/177): postgresql-13.11-1.el9.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2024-01-27T14:24:48.261 INFO:teuthology.orchestra.run.smithi073.stdout:(81/177): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-01-27T14:24:48.303 INFO:teuthology.orchestra.run.smithi073.stdout:(82/177): postgresql-private-libs-13.11-1.el9.x 3.1 MB/s | 134 kB 00:00 2024-01-27T14:24:48.453 INFO:teuthology.orchestra.run.smithi073.stdout:(83/177): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-01-27T14:24:48.487 INFO:teuthology.orchestra.run.smithi073.stdout:(84/177): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-01-27T14:24:48.637 INFO:teuthology.orchestra.run.smithi073.stdout:(85/177): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-01-27T14:24:48.679 INFO:teuthology.orchestra.run.smithi073.stdout:(86/177): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2024-01-27T14:24:48.713 INFO:teuthology.orchestra.run.smithi073.stdout:(87/177): python3-jsonpatch-1.21-16.el9.noarch. 735 kB/s | 24 kB 00:00 2024-01-27T14:24:48.746 INFO:teuthology.orchestra.run.smithi073.stdout:(88/177): python3-jsonpointer-2.0-4.el9.noarch. 541 kB/s | 18 kB 00:00 2024-01-27T14:24:48.788 INFO:teuthology.orchestra.run.smithi073.stdout:(89/177): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-01-27T14:24:48.822 INFO:teuthology.orchestra.run.smithi073.stdout:(90/177): python3-markupsafe-1.1.1-12.el9.x86_6 943 kB/s | 32 kB 00:00 2024-01-27T14:24:48.965 INFO:teuthology.orchestra.run.smithi073.stdout:(91/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-01-27T14:24:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:(92/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-01-27T14:24:49.039 INFO:teuthology.orchestra.run.smithi073.stdout:(93/177): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2024-01-27T14:24:49.073 INFO:teuthology.orchestra.run.smithi073.stdout:(94/177): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-01-27T14:24:49.107 INFO:teuthology.orchestra.run.smithi073.stdout:(95/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-01-27T14:24:49.157 INFO:teuthology.orchestra.run.smithi073.stdout:(96/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-01-27T14:24:49.199 INFO:teuthology.orchestra.run.smithi073.stdout:(97/177): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-01-27T14:24:49.233 INFO:teuthology.orchestra.run.smithi073.stdout:(98/177): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2024-01-27T14:24:49.633 INFO:teuthology.orchestra.run.smithi073.stdout:(99/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-01-27T14:24:49.667 INFO:teuthology.orchestra.run.smithi073.stdout:(100/177): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-01-27T14:24:49.700 INFO:teuthology.orchestra.run.smithi073.stdout:(101/177): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2024-01-27T14:24:49.742 INFO:teuthology.orchestra.run.smithi073.stdout:(102/177): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-01-27T14:24:49.776 INFO:teuthology.orchestra.run.smithi073.stdout:(103/177): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-01-27T14:24:49.809 INFO:teuthology.orchestra.run.smithi073.stdout:(104/177): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.6 MB/s | 87 kB 00:00 2024-01-27T14:24:49.865 INFO:teuthology.orchestra.run.smithi073.stdout:(105/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-01-27T14:24:49.901 INFO:teuthology.orchestra.run.smithi073.stdout:(106/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.2 MB/s | 44 kB 00:00 2024-01-27T14:24:49.935 INFO:teuthology.orchestra.run.smithi073.stdout:(107/177): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-01-27T14:24:49.969 INFO:teuthology.orchestra.run.smithi073.stdout:(108/177): jq-1.6-16.el9.x86_64.rpm 5.4 MB/s | 186 kB 00:00 2024-01-27T14:24:50.027 INFO:teuthology.orchestra.run.smithi073.stdout:(109/177): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-01-27T14:24:50.078 INFO:teuthology.orchestra.run.smithi073.stdout:(110/177): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 194 kB 00:00 2024-01-27T14:24:50.128 INFO:teuthology.orchestra.run.smithi073.stdout:(111/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-01-27T14:24:50.178 INFO:teuthology.orchestra.run.smithi073.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-01-27T14:24:50.262 INFO:teuthology.orchestra.run.smithi073.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 14 MB/s | 1.1 MB 00:00 2024-01-27T14:24:50.321 INFO:teuthology.orchestra.run.smithi073.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 103 kB 00:00 2024-01-27T14:24:50.379 INFO:teuthology.orchestra.run.smithi073.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2024-01-27T14:24:50.446 INFO:teuthology.orchestra.run.smithi073.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 1.7 MB/s | 113 kB 00:00 2024-01-27T14:24:50.538 INFO:teuthology.orchestra.run.smithi073.stdout:(117/177): python3-urllib3-1.26.5-5.el9.noarch. 2.0 MB/s | 187 kB 00:00 2024-01-27T14:24:51.047 INFO:teuthology.orchestra.run.smithi073.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 483 kB/s | 245 kB 00:00 2024-01-27T14:24:51.822 INFO:teuthology.orchestra.run.smithi073.stdout:(119/177): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-01-27T14:24:52.498 INFO:teuthology.orchestra.run.smithi073.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 458 kB/s | 309 kB 00:00 2024-01-27T14:24:53.421 INFO:teuthology.orchestra.run.smithi046.stdout:(32/177): librados2-debuginfo-19.0.0-880.g99a21 5.8 MB/s | 44 MB 00:07 2024-01-27T14:24:54.096 INFO:teuthology.orchestra.run.smithi046.stdout:(33/177): librgw2-19.0.0-880.g99a21c3b.el9.x86_ 7.1 MB/s | 4.8 MB 00:00 2024-01-27T14:24:54.154 INFO:teuthology.orchestra.run.smithi046.stdout:(34/177): python3-ceph-argparse-19.0.0-880.g99a 777 kB/s | 45 kB 00:00 2024-01-27T14:24:54.213 INFO:teuthology.orchestra.run.smithi046.stdout:(35/177): python3-ceph-common-19.0.0-880.g99a21 2.2 MB/s | 130 kB 00:00 2024-01-27T14:24:54.280 INFO:teuthology.orchestra.run.smithi046.stdout:(36/177): python3-cephfs-19.0.0-880.g99a21c3b.e 2.4 MB/s | 162 kB 00:00 2024-01-27T14:24:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-880.g 5.5 MB/s | 615 kB 00:00 2024-01-27T14:24:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:(38/177): python3-rados-19.0.0-880.g99a21c3b.el 2.4 MB/s | 321 kB 00:00 2024-01-27T14:24:54.747 INFO:teuthology.orchestra.run.smithi046.stdout:(39/177): python3-rados-debuginfo-19.0.0-880.g9 3.3 MB/s | 771 kB 00:00 2024-01-27T14:24:54.848 INFO:teuthology.orchestra.run.smithi046.stdout:(40/177): python3-rbd-19.0.0-880.g99a21c3b.el9. 2.9 MB/s | 298 kB 00:00 2024-01-27T14:24:55.131 INFO:teuthology.orchestra.run.smithi073.stdout:(121/177): ceph-test-debuginfo-19.0.0-880.g99a2 8.5 MB/s | 664 MB 01:18 2024-01-27T14:24:55.164 INFO:teuthology.orchestra.run.smithi046.stdout:(41/177): python3-rbd-debuginfo-19.0.0-880.g99a 3.6 MB/s | 1.1 MB 00:00 2024-01-27T14:24:55.223 INFO:teuthology.orchestra.run.smithi046.stdout:(42/177): python3-rgw-19.0.0-880.g99a21c3b.el9. 1.7 MB/s | 99 kB 00:00 2024-01-27T14:24:55.332 INFO:teuthology.orchestra.run.smithi046.stdout:(43/177): python3-rgw-debuginfo-19.0.0-880.g99a 3.0 MB/s | 337 kB 00:00 2024-01-27T14:24:55.399 INFO:teuthology.orchestra.run.smithi046.stdout:(44/177): rbd-fuse-19.0.0-880.g99a21c3b.el9.x86 1.3 MB/s | 85 kB 00:00 2024-01-27T14:24:55.516 INFO:teuthology.orchestra.run.smithi046.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-880.g99a21c 4.3 MB/s | 509 kB 00:00 2024-01-27T14:24:55.590 INFO:teuthology.orchestra.run.smithi073.stdout:(122/177): rbd-mirror-debuginfo-19.0.0-880.g99a 2.8 MB/s | 52 MB 00:18 2024-01-27T14:24:55.665 INFO:teuthology.orchestra.run.smithi073.stdout:(123/177): libarrow-9.0.0-10.el9.x86_64.rpm 1.4 MB/s | 4.4 MB 00:03 2024-01-27T14:24:55.790 INFO:teuthology.orchestra.run.smithi073.stdout:(124/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 39 kB/s | 26 kB 00:00 2024-01-27T14:24:55.965 INFO:teuthology.orchestra.run.smithi073.stdout:(125/177): libunwind-1.6.2-1.el9.x86_64.rpm 224 kB/s | 67 kB 00:00 2024-01-27T14:24:55.990 INFO:teuthology.orchestra.run.smithi073.stdout:(126/177): liboath-2.6.7-2.el9.x86_64.rpm 121 kB/s | 49 kB 00:00 2024-01-27T14:24:56.082 INFO:teuthology.orchestra.run.smithi046.stdout:(46/177): rbd-mirror-19.0.0-880.g99a21c3b.el9.x 5.5 MB/s | 3.1 MB 00:00 2024-01-27T14:24:56.099 INFO:teuthology.orchestra.run.smithi073.stdout:(127/177): luarocks-3.9.2-1.el9.noarch.rpm 489 kB/s | 151 kB 00:00 2024-01-27T14:24:56.216 INFO:teuthology.orchestra.run.smithi073.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 373 kB/s | 43 kB 00:00 2024-01-27T14:24:56.333 INFO:teuthology.orchestra.run.smithi073.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2024-01-27T14:24:56.358 INFO:teuthology.orchestra.run.smithi073.stdout:(130/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.1 MB/s | 838 kB 00:00 2024-01-27T14:24:56.391 INFO:teuthology.orchestra.run.smithi073.stdout:(131/177): python3-asyncssh-2.13.2-3.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-01-27T14:24:56.442 INFO:teuthology.orchestra.run.smithi073.stdout:(132/177): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-01-27T14:24:56.467 INFO:teuthology.orchestra.run.smithi073.stdout:(133/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-01-27T14:24:56.501 INFO:teuthology.orchestra.run.smithi073.stdout:(134/177): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-01-27T14:24:56.576 INFO:teuthology.orchestra.run.smithi073.stdout:(135/177): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-01-27T14:24:56.610 INFO:teuthology.orchestra.run.smithi073.stdout:(136/177): python3-google-auth-2.26.2-1.el9.noa 1.8 MB/s | 202 kB 00:00 2024-01-27T14:24:56.685 INFO:teuthology.orchestra.run.smithi073.stdout:(137/177): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-01-27T14:24:56.718 INFO:teuthology.orchestra.run.smithi073.stdout:(138/177): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-01-27T14:24:56.794 INFO:teuthology.orchestra.run.smithi073.stdout:(139/177): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-01-27T14:24:56.828 INFO:teuthology.orchestra.run.smithi073.stdout:(140/177): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2024-01-27T14:24:56.861 INFO:teuthology.orchestra.run.smithi073.stdout:(141/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 723 kB/s | 303 kB 00:00 2024-01-27T14:24:56.886 INFO:teuthology.orchestra.run.smithi073.stdout:(142/177): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-01-27T14:24:56.962 INFO:teuthology.orchestra.run.smithi073.stdout:(143/177): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-01-27T14:24:56.987 INFO:teuthology.orchestra.run.smithi073.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 785 kB/s | 79 kB 00:00 2024-01-27T14:24:57.020 INFO:teuthology.orchestra.run.smithi073.stdout:(145/177): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-01-27T14:24:57.046 INFO:teuthology.orchestra.run.smithi073.stdout:(146/177): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-01-27T14:24:57.088 INFO:teuthology.orchestra.run.smithi073.stdout:(147/177): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-01-27T14:24:57.113 INFO:teuthology.orchestra.run.smithi073.stdout:(148/177): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-01-27T14:24:57.180 INFO:teuthology.orchestra.run.smithi073.stdout:(149/177): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-01-27T14:24:57.205 INFO:teuthology.orchestra.run.smithi073.stdout:(150/177): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-01-27T14:24:57.231 INFO:teuthology.orchestra.run.smithi073.stdout:(151/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 488 kB/s | 90 kB 00:00 2024-01-27T14:24:57.281 INFO:teuthology.orchestra.run.smithi073.stdout:(152/177): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-01-27T14:24:57.314 INFO:teuthology.orchestra.run.smithi073.stdout:(153/177): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-01-27T14:24:57.339 INFO:teuthology.orchestra.run.smithi073.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-01-27T14:24:57.382 INFO:teuthology.orchestra.run.smithi073.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-01-27T14:24:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:(156/177): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-01-27T14:24:57.574 INFO:teuthology.orchestra.run.smithi073.stdout:(157/177): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-01-27T14:24:57.607 INFO:teuthology.orchestra.run.smithi073.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 1.9 MB/s | 427 kB 00:00 2024-01-27T14:24:57.633 INFO:teuthology.orchestra.run.smithi073.stdout:(159/177): python3-webob-1.8.7-6.el9.noarch.rpm 722 kB/s | 230 kB 00:00 2024-01-27T14:24:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-01-27T14:24:58.026 INFO:teuthology.orchestra.run.smithi073.stdout:(161/177): librbd1-19.0.0-880.g99a21c3b.el9.x86 9.6 MB/s | 3.1 MB 00:00 2024-01-27T14:24:58.058 INFO:teuthology.orchestra.run.smithi073.stdout:(162/177): thrift-0.15.0-2.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-01-27T14:24:58.083 INFO:teuthology.orchestra.run.smithi073.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2024-01-27T14:24:58.176 INFO:teuthology.orchestra.run.smithi073.stdout:(164/177): NetworkManager-1.45.10-1.el9.x86_64. 19 MB/s | 2.2 MB 00:00 2024-01-27T14:24:58.218 INFO:teuthology.orchestra.run.smithi073.stdout:(165/177): NetworkManager-libnm-1.45.10-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-01-27T14:24:58.243 INFO:teuthology.orchestra.run.smithi073.stdout:(166/177): NetworkManager-team-1.45.10-1.el9.x8 656 kB/s | 42 kB 00:00 2024-01-27T14:24:58.276 INFO:teuthology.orchestra.run.smithi073.stdout:(167/177): NetworkManager-tui-1.45.10-1.el9.x86 4.1 MB/s | 246 kB 00:00 2024-01-27T14:24:58.301 INFO:teuthology.orchestra.run.smithi073.stdout:(168/177): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2024-01-27T14:24:58.327 INFO:teuthology.orchestra.run.smithi073.stdout:(169/177): elfutils-debuginfod-client-0.190-2.e 708 kB/s | 35 kB 00:00 2024-01-27T14:24:58.352 INFO:teuthology.orchestra.run.smithi073.stdout:(170/177): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-01-27T14:24:58.380 INFO:teuthology.orchestra.run.smithi073.stdout:(171/177): elfutils-libs-0.190-2.el9.x86_64.rpm 4.8 MB/s | 254 kB 00:00 2024-01-27T14:24:58.405 INFO:teuthology.orchestra.run.smithi073.stdout:(172/177): libacl-2.3.1-4.el9.x86_64.rpm 422 kB/s | 22 kB 00:00 2024-01-27T14:24:58.464 INFO:teuthology.orchestra.run.smithi073.stdout:(173/177): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-27T14:24:58.522 INFO:teuthology.orchestra.run.smithi073.stdout:(174/177): librados2-19.0.0-880.g99a21c3b.el9.x 3.8 MB/s | 3.4 MB 00:00 2024-01-27T14:24:58.564 INFO:teuthology.orchestra.run.smithi073.stdout:(175/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-01-27T14:24:58.589 INFO:teuthology.orchestra.run.smithi073.stdout:(176/177): xfsdump-3.1.12-4.el9.x86_64.rpm 2.6 MB/s | 321 kB 00:00 2024-01-27T14:24:58.622 INFO:teuthology.orchestra.run.smithi073.stdout:(177/177): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-01-27T14:24:58.628 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-01-27T14:24:58.628 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 2.1 GB 02:31 2024-01-27T14:24:58.659 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-01-27T14:24:58.940 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-01-27T14:24:58.940 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-01-27T14:25:00.691 INFO:teuthology.orchestra.run.smithi046.stdout:(47/177): librbd1-debuginfo-19.0.0-880.g99a21c3 3.7 MB/s | 52 MB 00:14 2024-01-27T14:25:00.782 INFO:teuthology.orchestra.run.smithi046.stdout:(48/177): rbd-nbd-19.0.0-880.g99a21c3b.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-01-27T14:25:01.016 INFO:teuthology.orchestra.run.smithi046.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-880.g99a21c3 5.4 MB/s | 1.3 MB 00:00 2024-01-27T14:25:01.158 INFO:teuthology.orchestra.run.smithi046.stdout:(50/177): ceph-grafana-dashboards-19.0.0-880.g9 201 kB/s | 28 kB 00:00 2024-01-27T14:25:01.216 INFO:teuthology.orchestra.run.smithi046.stdout:(51/177): ceph-mgr-cephadm-19.0.0-880.g99a21c3b 2.2 MB/s | 133 kB 00:00 2024-01-27T14:25:01.583 INFO:teuthology.orchestra.run.smithi046.stdout:(52/177): ceph-mgr-dashboard-19.0.0-880.g99a21c 4.7 MB/s | 1.7 MB 00:00 2024-01-27T14:25:03.192 INFO:teuthology.orchestra.run.smithi046.stdout:(53/177): rbd-mirror-debuginfo-19.0.0-880.g99a2 7.3 MB/s | 52 MB 00:07 2024-01-27T14:25:03.292 INFO:teuthology.orchestra.run.smithi046.stdout:(54/177): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-01-27T14:25:03.318 INFO:teuthology.orchestra.run.smithi046.stdout:(55/177): ceph-mgr-modules-core-19.0.0-880.g99a 1.9 MB/s | 245 kB 00:00 2024-01-27T14:25:03.368 INFO:teuthology.orchestra.run.smithi046.stdout:(56/177): ceph-mgr-rook-19.0.0-880.g99a21c3b.el 696 kB/s | 52 kB 00:00 2024-01-27T14:25:03.393 INFO:teuthology.orchestra.run.smithi046.stdout:(57/177): ceph-prometheus-alerts-19.0.0-880.g99 201 kB/s | 15 kB 00:00 2024-01-27T14:25:03.435 INFO:teuthology.orchestra.run.smithi046.stdout:(58/177): ceph-volume-19.0.0-880.g99a21c3b.el9. 3.8 MB/s | 262 kB 00:00 2024-01-27T14:25:03.569 INFO:teuthology.orchestra.run.smithi046.stdout:(59/177): cephfs-top-19.0.0-880.g99a21c3b.el9.n 137 kB/s | 18 kB 00:00 2024-01-27T14:25:03.605 INFO:teuthology.orchestra.run.smithi046.stdout:(60/177): cephadm-19.0.0-880.g99a21c3b.el9.noar 3.4 MB/s | 742 kB 00:00 2024-01-27T14:25:03.888 INFO:teuthology.orchestra.run.smithi046.stdout:(61/177): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2024-01-27T14:25:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-01-27T14:25:03.964 INFO:teuthology.orchestra.run.smithi046.stdout:(63/177): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 920 kB 00:00 2024-01-27T14:25:03.989 INFO:teuthology.orchestra.run.smithi046.stdout:(64/177): elfutils-libelf-devel-0.190-2.el9.x86 409 kB/s | 20 kB 00:00 2024-01-27T14:25:04.039 INFO:teuthology.orchestra.run.smithi046.stdout:(65/177): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-01-27T14:25:04.065 INFO:teuthology.orchestra.run.smithi046.stdout:(66/177): flexiblas-3.0.4-8.el9.x86_64.rpm 421 kB/s | 32 kB 00:00 2024-01-27T14:25:04.190 INFO:teuthology.orchestra.run.smithi046.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 138 kB/s | 17 kB 00:00 2024-01-27T14:25:04.240 INFO:teuthology.orchestra.run.smithi046.stdout:(68/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-01-27T14:25:04.257 INFO:teuthology.orchestra.run.smithi046.stdout:(69/177): libaio-devel-0.3.111-13.el9.x86_64.rp 151 kB/s | 10 kB 00:00 2024-01-27T14:25:04.316 INFO:teuthology.orchestra.run.smithi046.stdout:(70/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-01-27T14:25:04.332 INFO:teuthology.orchestra.run.smithi046.stdout:(71/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-01-27T14:25:04.374 INFO:teuthology.orchestra.run.smithi046.stdout:(72/177): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-01-27T14:25:04.400 INFO:teuthology.orchestra.run.smithi046.stdout:(73/177): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-01-27T14:25:04.425 INFO:teuthology.orchestra.run.smithi046.stdout:(74/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 499 kB/s | 24 kB 00:00 2024-01-27T14:25:04.458 INFO:teuthology.orchestra.run.smithi046.stdout:(75/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 795 kB/s | 46 kB 00:00 2024-01-27T14:25:04.484 INFO:teuthology.orchestra.run.smithi046.stdout:(76/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-01-27T14:25:04.509 INFO:teuthology.orchestra.run.smithi046.stdout:(77/177): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-01-27T14:25:04.526 INFO:teuthology.orchestra.run.smithi046.stdout:(78/177): openblas-0.3.21-2.el9.x86_64.rpm 823 kB/s | 34 kB 00:00 2024-01-27T14:25:04.718 INFO:teuthology.orchestra.run.smithi046.stdout:(79/177): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-01-27T14:25:04.818 INFO:teuthology.orchestra.run.smithi046.stdout:(80/177): openssl-devel-3.0.7-25.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-01-27T14:25:04.860 INFO:teuthology.orchestra.run.smithi046.stdout:(81/177): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-01-27T14:25:04.902 INFO:teuthology.orchestra.run.smithi046.stdout:(82/177): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2024-01-27T14:25:04.927 INFO:teuthology.orchestra.run.smithi046.stdout:(83/177): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2024-01-27T14:25:05.144 INFO:teuthology.orchestra.run.smithi046.stdout:(84/177): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-01-27T14:25:05.169 INFO:teuthology.orchestra.run.smithi046.stdout:(85/177): python3-attrs-20.3.0-7.el9.noarch.rpm 321 kB/s | 78 kB 00:00 2024-01-27T14:25:05.420 INFO:teuthology.orchestra.run.smithi046.stdout:(86/177): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-01-27T14:25:05.445 INFO:teuthology.orchestra.run.smithi046.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 830 kB/s | 228 kB 00:00 2024-01-27T14:25:05.479 INFO:teuthology.orchestra.run.smithi046.stdout:(88/177): python3-jsonpatch-1.21-16.el9.noarch. 420 kB/s | 24 kB 00:00 2024-01-27T14:25:05.512 INFO:teuthology.orchestra.run.smithi046.stdout:(89/177): python3-jsonpointer-2.0-4.el9.noarch. 270 kB/s | 18 kB 00:00 2024-01-27T14:25:05.555 INFO:teuthology.orchestra.run.smithi046.stdout:(90/177): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-01-27T14:25:05.580 INFO:teuthology.orchestra.run.smithi046.stdout:(91/177): python3-markupsafe-1.1.1-12.el9.x86_6 470 kB/s | 32 kB 00:00 2024-01-27T14:25:05.772 INFO:teuthology.orchestra.run.smithi046.stdout:(92/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-01-27T14:25:05.797 INFO:teuthology.orchestra.run.smithi046.stdout:(93/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2024-01-27T14:25:05.822 INFO:teuthology.orchestra.run.smithi046.stdout:(94/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-01-27T14:25:05.847 INFO:teuthology.orchestra.run.smithi046.stdout:(95/177): python3-prettytable-0.7.2-27.el9.noar 828 kB/s | 41 kB 00:00 2024-01-27T14:25:05.873 INFO:teuthology.orchestra.run.smithi046.stdout:(96/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-01-27T14:25:05.898 INFO:teuthology.orchestra.run.smithi046.stdout:(97/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-01-27T14:25:05.923 INFO:teuthology.orchestra.run.smithi046.stdout:(98/177): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-01-27T14:25:05.957 INFO:teuthology.orchestra.run.smithi046.stdout:(99/177): python3-requests-oauthlib-1.3.0-12.el 733 kB/s | 43 kB 00:00 2024-01-27T14:25:06.207 INFO:teuthology.orchestra.run.smithi046.stdout:(100/177): python3-toml-0.10.2-6.el9.noarch.rpm 155 kB/s | 39 kB 00:00 2024-01-27T14:25:06.541 INFO:teuthology.orchestra.run.smithi046.stdout:(101/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-01-27T14:25:06.566 INFO:teuthology.orchestra.run.smithi046.stdout:(102/177): python3-wcwidth-0.2.5-8.el9.noarch.r 115 kB/s | 41 kB 00:00 2024-01-27T14:25:06.600 INFO:teuthology.orchestra.run.smithi046.stdout:(103/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-01-27T14:25:06.625 INFO:teuthology.orchestra.run.smithi046.stdout:(104/177): uuid-1.6.2-55.el9.x86_64.rpm 967 kB/s | 56 kB 00:00 2024-01-27T14:25:06.650 INFO:teuthology.orchestra.run.smithi046.stdout:(105/177): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.7 MB/s | 87 kB 00:00 2024-01-27T14:25:06.676 INFO:teuthology.orchestra.run.smithi046.stdout:(106/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-01-27T14:25:06.701 INFO:teuthology.orchestra.run.smithi046.stdout:(107/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 875 kB/s | 44 kB 00:00 2024-01-27T14:25:06.726 INFO:teuthology.orchestra.run.smithi046.stdout:(108/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-27T14:25:06.751 INFO:teuthology.orchestra.run.smithi046.stdout:(109/177): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-01-27T14:25:06.793 INFO:teuthology.orchestra.run.smithi046.stdout:(110/177): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-01-27T14:25:06.818 INFO:teuthology.orchestra.run.smithi046.stdout:(111/177): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 194 kB 00:00 2024-01-27T14:25:06.844 INFO:teuthology.orchestra.run.smithi046.stdout:(112/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-01-27T14:25:06.869 INFO:teuthology.orchestra.run.smithi046.stdout:(113/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-01-27T14:25:06.936 INFO:teuthology.orchestra.run.smithi046.stdout:(114/177): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-01-27T14:25:06.961 INFO:teuthology.orchestra.run.smithi046.stdout:(115/177): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-01-27T14:25:06.986 INFO:teuthology.orchestra.run.smithi046.stdout:(116/177): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-01-27T14:25:07.012 INFO:teuthology.orchestra.run.smithi046.stdout:(117/177): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-01-27T14:25:07.037 INFO:teuthology.orchestra.run.smithi046.stdout:(118/177): python3-urllib3-1.26.5-5.el9.noarch. 3.6 MB/s | 187 kB 00:00 2024-01-27T14:25:07.221 INFO:teuthology.orchestra.run.smithi046.stdout:(119/177): lua-devel-5.4.4-4.el9.x86_64.rpm 122 kB/s | 22 kB 00:00 2024-01-27T14:25:07.563 INFO:teuthology.orchestra.run.smithi046.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 903 kB/s | 309 kB 00:00 2024-01-27T14:25:07.588 INFO:teuthology.orchestra.run.smithi046.stdout:(121/177): python3-devel-3.9.17-2.el9.x86_64.rp 426 kB/s | 245 kB 00:00 2024-01-27T14:25:07.839 INFO:teuthology.orchestra.run.smithi046.stdout:(122/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-01-27T14:25:07.972 INFO:teuthology.orchestra.run.smithi046.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 365 kB/s | 49 kB 00:00 2024-01-27T14:25:08.039 INFO:teuthology.orchestra.run.smithi046.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-01-27T14:25:08.139 INFO:teuthology.orchestra.run.smithi046.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-01-27T14:25:08.414 INFO:teuthology.orchestra.run.smithi046.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-01-27T14:25:08.565 INFO:teuthology.orchestra.run.smithi046.stdout:(127/177): libarrow-9.0.0-10.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-01-27T14:25:08.590 INFO:teuthology.orchestra.run.smithi046.stdout:(128/177): python3-asyncssh-2.13.2-3.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-01-27T14:25:08.623 INFO:teuthology.orchestra.run.smithi046.stdout:(129/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-01-27T14:25:08.640 INFO:teuthology.orchestra.run.smithi046.stdout:(130/177): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-01-27T14:25:08.674 INFO:teuthology.orchestra.run.smithi046.stdout:(131/177): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-01-27T14:25:08.699 INFO:teuthology.orchestra.run.smithi046.stdout:(132/177): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-01-27T14:25:08.750 INFO:teuthology.orchestra.run.smithi046.stdout:(133/177): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-01-27T14:25:08.800 INFO:teuthology.orchestra.run.smithi046.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 709 kB/s | 35 kB 00:00 2024-01-27T14:25:08.825 INFO:teuthology.orchestra.run.smithi046.stdout:(135/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-01-27T14:25:08.859 INFO:teuthology.orchestra.run.smithi046.stdout:(136/177): python3-google-auth-2.26.2-1.el9.noa 3.4 MB/s | 202 kB 00:00 2024-01-27T14:25:08.876 INFO:teuthology.orchestra.run.smithi046.stdout:(137/177): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-01-27T14:25:08.901 INFO:teuthology.orchestra.run.smithi046.stdout:(138/177): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-01-27T14:25:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:(139/177): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-01-27T14:25:08.952 INFO:teuthology.orchestra.run.smithi046.stdout:(140/177): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-01-27T14:25:08.968 INFO:teuthology.orchestra.run.smithi046.stdout:(141/177): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-01-27T14:25:09.019 INFO:teuthology.orchestra.run.smithi046.stdout:(142/177): python3-logutils-0.3.5-21.el9.noarch 924 kB/s | 46 kB 00:00 2024-01-27T14:25:09.086 INFO:teuthology.orchestra.run.smithi046.stdout:(143/177): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-01-27T14:25:09.111 INFO:teuthology.orchestra.run.smithi046.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 860 kB/s | 79 kB 00:00 2024-01-27T14:25:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:(145/177): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-01-27T14:25:09.187 INFO:teuthology.orchestra.run.smithi046.stdout:(146/177): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-01-27T14:25:09.212 INFO:teuthology.orchestra.run.smithi046.stdout:(147/177): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-01-27T14:25:09.245 INFO:teuthology.orchestra.run.smithi046.stdout:(148/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-01-27T14:25:09.271 INFO:teuthology.orchestra.run.smithi046.stdout:(149/177): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-01-27T14:25:09.296 INFO:teuthology.orchestra.run.smithi046.stdout:(150/177): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-01-27T14:25:09.330 INFO:teuthology.orchestra.run.smithi046.stdout:(151/177): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-01-27T14:25:09.347 INFO:teuthology.orchestra.run.smithi046.stdout:(152/177): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-01-27T14:25:09.381 INFO:teuthology.orchestra.run.smithi046.stdout:(153/177): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-01-27T14:25:09.397 INFO:teuthology.orchestra.run.smithi046.stdout:(154/177): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-01-27T14:25:09.448 INFO:teuthology.orchestra.run.smithi046.stdout:(155/177): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-01-27T14:25:09.473 INFO:teuthology.orchestra.run.smithi046.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-01-27T14:25:09.506 INFO:teuthology.orchestra.run.smithi046.stdout:(157/177): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-01-27T14:25:09.532 INFO:teuthology.orchestra.run.smithi046.stdout:(158/177): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-01-27T14:25:09.566 INFO:teuthology.orchestra.run.smithi046.stdout:(159/177): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-01-27T14:25:09.782 INFO:teuthology.orchestra.run.smithi046.stdout:(160/177): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-01-27T14:25:10.541 INFO:teuthology.orchestra.run.smithi046.stdout:(161/177): librados2-19.0.0-880.g99a21c3b.el9.x 3.4 MB/s | 3.4 MB 00:00 2024-01-27T14:25:10.600 INFO:teuthology.orchestra.run.smithi046.stdout:(162/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2024-01-27T14:25:10.775 INFO:teuthology.orchestra.run.smithi046.stdout:(163/177): NetworkManager-1.45.10-1.el9.x86_64. 13 MB/s | 2.2 MB 00:00 2024-01-27T14:25:10.909 INFO:teuthology.orchestra.run.smithi046.stdout:(164/177): librbd1-19.0.0-880.g99a21c3b.el9.x86 2.8 MB/s | 3.1 MB 00:01 2024-01-27T14:25:10.950 INFO:teuthology.orchestra.run.smithi046.stdout:(165/177): NetworkManager-libnm-1.45.10-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-01-27T14:25:10.975 INFO:teuthology.orchestra.run.smithi046.stdout:(166/177): NetworkManager-team-1.45.10-1.el9.x8 642 kB/s | 42 kB 00:00 2024-01-27T14:25:11.034 INFO:teuthology.orchestra.run.smithi046.stdout:(167/177): NetworkManager-tui-1.45.10-1.el9.x86 2.9 MB/s | 246 kB 00:00 2024-01-27T14:25:11.059 INFO:teuthology.orchestra.run.smithi046.stdout:(168/177): acl-2.3.1-4.el9.x86_64.rpm 824 kB/s | 69 kB 00:00 2024-01-27T14:25:11.102 INFO:teuthology.orchestra.run.smithi046.stdout:(169/177): elfutils-debuginfod-client-0.190-2.e 530 kB/s | 35 kB 00:00 2024-01-27T14:25:11.127 INFO:teuthology.orchestra.run.smithi046.stdout:(170/177): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 191 kB 00:00 2024-01-27T14:25:11.152 INFO:teuthology.orchestra.run.smithi046.stdout:(171/177): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-01-27T14:25:11.169 INFO:teuthology.orchestra.run.smithi046.stdout:(172/177): libacl-2.3.1-4.el9.x86_64.rpm 529 kB/s | 22 kB 00:00 2024-01-27T14:25:11.236 INFO:teuthology.orchestra.run.smithi046.stdout:(173/177): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-27T14:25:11.319 INFO:teuthology.orchestra.run.smithi046.stdout:(174/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-01-27T14:25:11.345 INFO:teuthology.orchestra.run.smithi046.stdout:(175/177): xfsdump-3.1.12-4.el9.x86_64.rpm 2.9 MB/s | 321 kB 00:00 2024-01-27T14:25:11.403 INFO:teuthology.orchestra.run.smithi046.stdout:(176/177): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-27T14:25:12.203 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-01-27T14:25:12.203 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-01-27T14:25:32.646 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-01-27T14:25:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T14:25:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/193 2024-01-27T14:25:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/193 2024-01-27T14:25:33.011 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/193 2024-01-27T14:25:33.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/193 2024-01-27T14:25:33.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/193 2024-01-27T14:25:33.102 INFO:teuthology.orchestra.run.smithi046.stdout:(177/177): ceph-test-debuginfo-19.0.0-880.g99a2 13 MB/s | 664 MB 00:52 2024-01-27T14:25:33.109 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-01-27T14:25:33.109 INFO:teuthology.orchestra.run.smithi046.stdout:Total 11 MB/s | 2.1 GB 03:09 2024-01-27T14:25:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/193 2024-01-27T14:25:33.136 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-01-27T14:25:33.442 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-01-27T14:25:33.442 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-01-27T14:25:33.451 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/193 2024-01-27T14:25:33.510 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T14:25:33.631 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T14:25:33.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T14:25:33.745 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T14:25:33.778 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T14:25:33.881 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/193 2024-01-27T14:25:33.989 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 13/193 2024-01-27T14:25:34.174 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/193 2024-01-27T14:25:34.224 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/193 2024-01-27T14:25:34.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T14:25:34.355 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T14:25:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T14:25:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T14:25:34.604 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/193 2024-01-27T14:25:34.724 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T14:25:34.784 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T14:25:34.886 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:25:34.936 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:25:35.217 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:25:35.248 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/193 2024-01-27T14:25:35.317 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/193 2024-01-27T14:25:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 23/193 2024-01-27T14:25:35.410 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 24/193 2024-01-27T14:25:35.462 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/193 2024-01-27T14:25:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/193 2024-01-27T14:25:35.575 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 27/193 2024-01-27T14:25:35.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 28/193 2024-01-27T14:25:35.653 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 29/193 2024-01-27T14:25:35.688 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/193 2024-01-27T14:25:35.758 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/193 2024-01-27T14:25:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T14:25:35.836 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 33/193 2024-01-27T14:25:35.866 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 34/193 2024-01-27T14:25:35.935 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/193 2024-01-27T14:25:36.013 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/193 2024-01-27T14:25:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/193 2024-01-27T14:25:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/193 2024-01-27T14:25:36.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/193 2024-01-27T14:25:36.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/193 2024-01-27T14:25:36.894 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 41/193 2024-01-27T14:25:36.934 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/193 2024-01-27T14:25:36.972 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 43/193 2024-01-27T14:25:37.018 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/193 2024-01-27T14:25:37.157 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/193 2024-01-27T14:25:37.210 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 46/193 2024-01-27T14:25:37.320 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 47/193 2024-01-27T14:25:37.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 48/193 2024-01-27T14:25:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/193 2024-01-27T14:25:37.484 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/193 2024-01-27T14:25:37.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/193 2024-01-27T14:25:37.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/193 2024-01-27T14:25:37.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/193 2024-01-27T14:25:37.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/193 2024-01-27T14:25:37.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/193 2024-01-27T14:25:37.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/193 2024-01-27T14:25:37.863 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/193 2024-01-27T14:25:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/193 2024-01-27T14:25:37.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/193 2024-01-27T14:25:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/193 2024-01-27T14:25:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/193 2024-01-27T14:25:38.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 62/193 2024-01-27T14:25:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/193 2024-01-27T14:25:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/193 2024-01-27T14:25:38.321 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 65/193 2024-01-27T14:25:38.361 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 66/193 2024-01-27T14:25:38.410 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/193 2024-01-27T14:25:38.474 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/193 2024-01-27T14:25:38.670 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/193 2024-01-27T14:25:38.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 70/193 2024-01-27T14:25:38.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/193 2024-01-27T14:25:38.889 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 72/193 2024-01-27T14:25:38.922 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/193 2024-01-27T14:25:38.962 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 74/193 2024-01-27T14:25:38.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 75/193 2024-01-27T14:25:39.028 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 76/193 2024-01-27T14:25:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 77/193 2024-01-27T14:25:39.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 78/193 2024-01-27T14:25:39.139 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 79/193 2024-01-27T14:25:39.170 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 80/193 2024-01-27T14:25:39.200 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/193 2024-01-27T14:25:39.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/193 2024-01-27T14:25:39.310 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/193 2024-01-27T14:25:39.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/193 2024-01-27T14:25:39.385 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/193 2024-01-27T14:25:39.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/193 2024-01-27T14:25:39.510 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/193 2024-01-27T14:25:39.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/193 2024-01-27T14:25:39.659 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/193 2024-01-27T14:25:39.716 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/193 2024-01-27T14:25:40.454 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/193 2024-01-27T14:25:40.504 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/193 2024-01-27T14:25:40.538 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/193 2024-01-27T14:25:40.586 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/193 2024-01-27T14:25:40.676 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/193 2024-01-27T14:25:40.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/193 2024-01-27T14:25:40.892 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 97/193 2024-01-27T14:25:40.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 98/193 2024-01-27T14:25:41.023 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/193 2024-01-27T14:25:41.717 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/193 2024-01-27T14:25:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/193 2024-01-27T14:25:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/193 2024-01-27T14:25:43.184 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/193 2024-01-27T14:25:43.212 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/193 2024-01-27T14:25:43.245 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/193 2024-01-27T14:25:43.570 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/193 2024-01-27T14:25:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T14:25:43.684 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T14:25:43.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 108/193 2024-01-27T14:25:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/193 2024-01-27T14:25:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/193 2024-01-27T14:25:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T14:25:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T14:25:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 112/193 2024-01-27T14:25:46.378 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:25:46.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:25:46.972 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:25:47.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T14:25:47.289 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T14:25:47.289 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-27T14:25:47.289 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-27T14:25:47.290 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:25:47.325 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T14:25:47.328 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-01-27T14:25:47.329 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-01-27T14:25:59.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:25:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T14:25:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T14:25:59.747 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:25:59.747 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-27T14:25:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:01.209 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T14:26:01.234 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:01.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T14:26:01.474 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T14:26:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:02.021 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 120/193 2024-01-27T14:26:02.426 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T14:26:02.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T14:26:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 122/193 2024-01-27T14:26:02.544 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 123/193 2024-01-27T14:26:02.567 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T14:26:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T14:26:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T14:26:03.781 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T14:26:03.819 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T14:26:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T14:26:04.072 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 127/193 2024-01-27T14:26:04.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T14:26:04.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:04.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T14:26:04.190 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T14:26:04.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 130/193 2024-01-27T14:26:05.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/193 2024-01-27T14:26:05.057 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T14:26:05.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:05.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T14:26:05.154 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T14:26:05.154 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:05.155 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-27T14:26:05.155 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:05.208 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T14:26:05.230 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T14:26:05.230 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:05.230 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-27T14:26:05.230 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T14:26:05.231 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T14:26:05.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:05.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T14:26:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:26:08.587 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-01-27T14:26:08.720 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T14:26:08.787 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/193 2024-01-27T14:26:08.830 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/193 2024-01-27T14:26:08.890 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/193 2024-01-27T14:26:08.930 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/193 2024-01-27T14:26:08.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/193 2024-01-27T14:26:09.006 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/193 2024-01-27T14:26:09.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/193 2024-01-27T14:26:09.422 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T14:26:09.555 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T14:26:09.582 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T14:26:09.674 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T14:26:09.707 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T14:26:09.791 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/193 2024-01-27T14:26:09.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 136/193 2024-01-27T14:26:09.895 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 137/193 2024-01-27T14:26:09.899 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 13/193 2024-01-27T14:26:09.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 138/193 2024-01-27T14:26:09.968 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/193 2024-01-27T14:26:09.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/193 2024-01-27T14:26:10.087 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/193 2024-01-27T14:26:10.136 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/193 2024-01-27T14:26:10.163 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T14:26:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 141/193 2024-01-27T14:26:10.252 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T14:26:10.281 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T14:26:10.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/193 2024-01-27T14:26:10.326 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T14:26:10.326 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 143/193 2024-01-27T14:26:10.351 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 144/193 2024-01-27T14:26:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 145/193 2024-01-27T14:26:10.429 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 146/193 2024-01-27T14:26:10.499 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/193 2024-01-27T14:26:10.502 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 147/193 2024-01-27T14:26:10.556 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/193 2024-01-27T14:26:10.595 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/193 2024-01-27T14:26:10.635 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T14:26:10.678 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T14:26:10.774 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:26:10.838 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:26:11.109 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T14:26:11.142 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/193 2024-01-27T14:26:11.167 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:11.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/193 2024-01-27T14:26:11.243 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:11.284 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 23/193 2024-01-27T14:26:11.291 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/193 2024-01-27T14:26:11.321 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 24/193 2024-01-27T14:26:11.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/193 2024-01-27T14:26:11.405 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/193 2024-01-27T14:26:11.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 27/193 2024-01-27T14:26:11.529 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 28/193 2024-01-27T14:26:11.563 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 29/193 2024-01-27T14:26:11.590 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/193 2024-01-27T14:26:11.663 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/193 2024-01-27T14:26:11.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T14:26:11.747 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 33/193 2024-01-27T14:26:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 34/193 2024-01-27T14:26:11.849 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/193 2024-01-27T14:26:11.925 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/193 2024-01-27T14:26:12.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/193 2024-01-27T14:26:12.098 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 152/193 2024-01-27T14:26:12.127 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/193 2024-01-27T14:26:12.688 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/193 2024-01-27T14:26:12.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/193 2024-01-27T14:26:12.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 41/193 2024-01-27T14:26:12.836 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/193 2024-01-27T14:26:12.874 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 43/193 2024-01-27T14:26:12.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/193 2024-01-27T14:26:13.076 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/193 2024-01-27T14:26:13.149 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 46/193 2024-01-27T14:26:13.260 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 47/193 2024-01-27T14:26:13.294 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 48/193 2024-01-27T14:26:13.352 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/193 2024-01-27T14:26:13.425 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/193 2024-01-27T14:26:13.461 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/193 2024-01-27T14:26:13.498 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/193 2024-01-27T14:26:13.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/193 2024-01-27T14:26:13.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/193 2024-01-27T14:26:13.624 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/193 2024-01-27T14:26:13.666 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/193 2024-01-27T14:26:13.807 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/193 2024-01-27T14:26:13.854 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/193 2024-01-27T14:26:13.884 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/193 2024-01-27T14:26:13.927 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/193 2024-01-27T14:26:14.025 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/193 2024-01-27T14:26:14.067 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 62/193 2024-01-27T14:26:14.108 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/193 2024-01-27T14:26:14.133 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/193 2024-01-27T14:26:14.232 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 65/193 2024-01-27T14:26:14.277 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 66/193 2024-01-27T14:26:14.336 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/193 2024-01-27T14:26:14.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/193 2024-01-27T14:26:14.606 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/193 2024-01-27T14:26:14.657 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 70/193 2024-01-27T14:26:14.802 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/193 2024-01-27T14:26:14.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 72/193 2024-01-27T14:26:14.879 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/193 2024-01-27T14:26:14.920 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 74/193 2024-01-27T14:26:14.954 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 75/193 2024-01-27T14:26:14.993 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 76/193 2024-01-27T14:26:15.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 77/193 2024-01-27T14:26:15.082 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 78/193 2024-01-27T14:26:15.120 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 79/193 2024-01-27T14:26:15.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 80/193 2024-01-27T14:26:15.181 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/193 2024-01-27T14:26:15.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/193 2024-01-27T14:26:15.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/193 2024-01-27T14:26:15.325 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/193 2024-01-27T14:26:15.367 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/193 2024-01-27T14:26:15.400 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/193 2024-01-27T14:26:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/193 2024-01-27T14:26:15.537 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/193 2024-01-27T14:26:15.645 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/193 2024-01-27T14:26:15.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/193 2024-01-27T14:26:16.477 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/193 2024-01-27T14:26:16.526 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/193 2024-01-27T14:26:16.560 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/193 2024-01-27T14:26:16.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/193 2024-01-27T14:26:16.709 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/193 2024-01-27T14:26:16.744 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/193 2024-01-27T14:26:16.931 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 97/193 2024-01-27T14:26:16.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 98/193 2024-01-27T14:26:17.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/193 2024-01-27T14:26:17.751 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/193 2024-01-27T14:26:17.869 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/193 2024-01-27T14:26:19.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 153/193 2024-01-27T14:26:19.188 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/193 2024-01-27T14:26:19.264 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/193 2024-01-27T14:26:19.284 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/193 2024-01-27T14:26:19.308 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/193 2024-01-27T14:26:19.632 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/193 2024-01-27T14:26:19.663 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T14:26:19.754 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T14:26:19.784 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 108/193 2024-01-27T14:26:19.821 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/193 2024-01-27T14:26:20.274 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/193 2024-01-27T14:26:20.299 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T14:26:20.370 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T14:26:20.392 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 112/193 2024-01-27T14:26:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:26:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:26:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T14:26:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T14:26:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T14:26:23.237 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-27T14:26:23.237 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-27T14:26:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T14:26:35.929 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T14:26:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-01-27T14:26:35.930 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:36.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T14:26:36.113 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T14:26:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-27T14:26:36.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:37.637 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T14:26:37.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:37.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T14:26:37.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:38.371 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T14:26:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T14:26:38.393 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:38.394 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-27T14:26:38.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T14:26:38.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T14:26:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:38.490 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 120/193 2024-01-27T14:26:38.895 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T14:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T14:26:38.985 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 122/193 2024-01-27T14:26:39.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 123/193 2024-01-27T14:26:39.070 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T14:26:39.303 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T14:26:39.337 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T14:26:40.349 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T14:26:40.379 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T14:26:40.483 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T14:26:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 127/193 2024-01-27T14:26:40.673 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T14:26:40.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:40.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T14:26:40.759 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T14:26:40.819 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 130/193 2024-01-27T14:26:41.640 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/193 2024-01-27T14:26:41.667 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T14:26:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T14:26:41.689 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:41.689 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-27T14:26:41.689 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T14:26:41.690 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T14:26:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:41.735 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T14:26:41.756 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T14:26:41.756 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:41.756 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-27T14:26:41.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T14:26:41.832 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T14:26:41.832 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:41.832 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-27T14:26:41.833 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T14:26:41.833 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T14:26:41.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:42.153 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T14:26:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:26:46.734 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 136/193 2024-01-27T14:26:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 137/193 2024-01-27T14:26:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 138/193 2024-01-27T14:26:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/193 2024-01-27T14:26:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/193 2024-01-27T14:26:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 141/193 2024-01-27T14:26:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/193 2024-01-27T14:26:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 143/193 2024-01-27T14:26:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 144/193 2024-01-27T14:26:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 145/193 2024-01-27T14:26:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 146/193 2024-01-27T14:26:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 147/193 2024-01-27T14:26:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/193 2024-01-27T14:26:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/193 2024-01-27T14:26:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T14:26:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/193 2024-01-27T14:26:49.068 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 152/193 2024-01-27T14:26:56.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 153/193 2024-01-27T14:26:58.039 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 154/193 2024-01-27T14:26:58.652 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 155/193 2024-01-27T14:26:58.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 156/193 2024-01-27T14:27:03.164 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 157/193 2024-01-27T14:27:05.370 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 158/193 2024-01-27T14:27:15.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 159/193 2024-01-27T14:27:38.030 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 154/193 2024-01-27T14:27:38.677 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 155/193 2024-01-27T14:27:39.066 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 156/193 2024-01-27T14:27:42.740 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 160/193 2024-01-27T14:27:44.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 157/193 2024-01-27T14:27:46.152 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 158/193 2024-01-27T14:27:56.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 159/193 2024-01-27T14:27:59.045 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 161/193 2024-01-27T14:28:25.785 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 160/193 2024-01-27T14:28:43.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 161/193 2024-01-27T14:29:04.759 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 162/193 2024-01-27T14:29:05.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 163/193 2024-01-27T14:29:05.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 164/193 2024-01-27T14:29:10.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 165/193 2024-01-27T14:29:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 166/193 2024-01-27T14:29:16.046 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 167/193 2024-01-27T14:29:16.353 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 168/193 2024-01-27T14:29:16.690 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 169/193 2024-01-27T14:29:16.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 170/193 2024-01-27T14:29:17.294 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 171/193 2024-01-27T14:29:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 172/193 2024-01-27T14:29:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 173/193 2024-01-27T14:29:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 174/193 2024-01-27T14:29:24.424 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/193 2024-01-27T14:29:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/193 2024-01-27T14:29:24.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/193 2024-01-27T14:29:25.207 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/193 2024-01-27T14:29:25.232 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T14:29:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/193 2024-01-27T14:29:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T14:29:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T14:29:25.396 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/193 2024-01-27T14:29:25.438 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/193 2024-01-27T14:29:25.469 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/193 2024-01-27T14:29:25.502 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 185/193 2024-01-27T14:29:25.502 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T14:29:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T14:29:25.611 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 187/193 2024-01-27T14:29:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:29:25.619 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:29:25.814 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:29:25.814 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T14:29:25.896 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T14:29:25.922 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 190/193 2024-01-27T14:29:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 191/193 2024-01-27T14:29:26.279 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 192/193 2024-01-27T14:29:26.348 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T14:29:35.349 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 3/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 4/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 5/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 6/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 7/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 8/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 9/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 10/193 2024-01-27T14:29:35.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 12/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 13/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 14/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 15/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 16/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 17/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 18/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 19/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 20/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 21/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 22/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 23/193 2024-01-27T14:29:35.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 24/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 25/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 26/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 27/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 28/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 29/193 2024-01-27T14:29:35.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 30/193 2024-01-27T14:29:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 31/193 2024-01-27T14:29:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T14:29:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 33/193 2024-01-27T14:29:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 34/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 35/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 36/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 37/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 38/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 39/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 40/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 41/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 42/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 43/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 44/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 45/193 2024-01-27T14:29:35.368 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 46/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 47/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 48/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 49/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 50/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 51/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 52/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 53/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 54/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 55/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 56/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 57/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 58/193 2024-01-27T14:29:35.369 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 59/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 60/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 61/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/193 2024-01-27T14:29:35.370 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 86/193 2024-01-27T14:29:35.371 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 87/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 88/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 89/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 90/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 91/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 92/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 93/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 95/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 96/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/193 2024-01-27T14:29:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 106/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 108/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 109/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 110/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 111/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 112/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 113/193 2024-01-27T14:29:35.373 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 114/193 2024-01-27T14:29:35.374 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 115/193 2024-01-27T14:29:35.374 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 116/193 2024-01-27T14:29:35.374 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 117/193 2024-01-27T14:29:35.374 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 118/193 2024-01-27T14:29:35.374 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 119/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 121/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 122/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 123/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 124/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 125/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 127/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 128/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 129/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 130/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 131/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 132/193 2024-01-27T14:29:35.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 133/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 134/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 135/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 136/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 137/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 138/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 139/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 140/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 141/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 142/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 143/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 144/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 145/193 2024-01-27T14:29:35.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 146/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 147/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 148/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 149/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 150/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 151/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 152/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 153/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 154/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 155/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 156/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 158/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/193 2024-01-27T14:29:35.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 160/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 161/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 162/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 163/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 164/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 165/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 166/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 167/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 168/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 169/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 170/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 171/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 172/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 174/193 2024-01-27T14:29:35.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-4.el9.x86_64 176/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-3.el9.x86_64 177/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 178/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 180/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 181/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 182/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 183/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 184/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 185/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 186/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 187/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 188/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 189/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 190/193 2024-01-27T14:29:35.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 191/193 2024-01-27T14:29:35.380 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 192/193 2024-01-27T14:29:38.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 193/193 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: acl-2.3.1-4.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-27T14:29:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-27T14:29:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-27T14:29:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.11-1.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-27T14:29:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-27T14:29:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-27T14:29:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-27T14:29:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-27T14:29:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-27T14:29:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-27T14:29:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:29:38.222 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-01-27T14:29:38.901 DEBUG:teuthology.parallel:result is None 2024-01-27T14:29:53.254 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 162/193 2024-01-27T14:29:53.839 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 163/193 2024-01-27T14:29:53.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 164/193 2024-01-27T14:29:58.826 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 165/193 2024-01-27T14:30:04.769 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 166/193 2024-01-27T14:30:04.880 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 167/193 2024-01-27T14:30:04.986 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 168/193 2024-01-27T14:30:05.125 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 169/193 2024-01-27T14:30:05.186 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 170/193 2024-01-27T14:30:05.268 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 171/193 2024-01-27T14:30:11.207 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 172/193 2024-01-27T14:30:11.664 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 173/193 2024-01-27T14:30:11.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 174/193 2024-01-27T14:30:12.319 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/193 2024-01-27T14:30:12.424 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/193 2024-01-27T14:30:12.454 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/193 2024-01-27T14:30:12.479 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/193 2024-01-27T14:30:12.504 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T14:30:12.531 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/193 2024-01-27T14:30:12.531 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T14:30:12.599 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T14:30:12.619 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/193 2024-01-27T14:30:12.664 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/193 2024-01-27T14:30:12.691 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/193 2024-01-27T14:30:12.717 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 185/193 2024-01-27T14:30:12.717 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T14:30:12.801 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T14:30:12.834 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 187/193 2024-01-27T14:30:12.842 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:30:12.842 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:30:13.036 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T14:30:13.037 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T14:30:13.121 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T14:30:13.145 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 190/193 2024-01-27T14:30:13.190 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 191/193 2024-01-27T14:30:13.221 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 192/193 2024-01-27T14:30:13.290 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T14:30:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 3/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 4/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 5/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 6/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 7/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 8/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 9/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 10/193 2024-01-27T14:30:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 12/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 13/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 14/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 15/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 16/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 17/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 18/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 19/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 20/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 21/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 22/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 23/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 24/193 2024-01-27T14:30:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 25/193 2024-01-27T14:30:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 26/193 2024-01-27T14:30:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 27/193 2024-01-27T14:30:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 28/193 2024-01-27T14:30:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 29/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 30/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 31/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 33/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 34/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 35/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 36/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 37/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 38/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 39/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 40/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 41/193 2024-01-27T14:30:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 42/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 43/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 44/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 45/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 46/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 47/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 48/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 49/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 50/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 51/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 52/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 53/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 54/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 55/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 56/193 2024-01-27T14:30:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 57/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 58/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 59/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 60/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 61/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/193 2024-01-27T14:30:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/193 2024-01-27T14:30:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 86/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 87/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 88/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 89/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 90/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 91/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 92/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 93/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 95/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 96/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/193 2024-01-27T14:30:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 106/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 108/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 109/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 110/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 111/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 112/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 113/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 114/193 2024-01-27T14:30:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 115/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 116/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 117/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 118/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 119/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 121/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 122/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 123/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 124/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 125/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 127/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 128/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 129/193 2024-01-27T14:30:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 130/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 131/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 132/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 133/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 134/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 135/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 136/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 137/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 138/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 139/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 140/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 141/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 142/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 143/193 2024-01-27T14:30:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 144/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 145/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 146/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 147/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 148/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 149/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 150/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 151/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 152/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 153/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 154/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 155/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 156/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 158/193 2024-01-27T14:30:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 160/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 161/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 162/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 163/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 164/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 165/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 166/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 167/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 168/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 169/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 170/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 171/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 172/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 174/193 2024-01-27T14:30:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-4.el9.x86_64 176/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-3.el9.x86_64 177/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 178/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 180/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 181/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 182/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 183/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 184/193 2024-01-27T14:30:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 185/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 186/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 187/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 188/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 189/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 190/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 191/193 2024-01-27T14:30:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 192/193 2024-01-27T14:30:25.049 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 193/193 2024-01-27T14:30:25.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:25.049 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-01-27T14:30:25.049 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: acl-2.3.1-4.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-27T14:30:25.050 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.051 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-01-27T14:30:25.052 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.053 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.054 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.055 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.056 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.057 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.059 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.059 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.059 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-27T14:30:25.060 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-27T14:30:25.061 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-27T14:30:25.062 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-27T14:30:25.063 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.11-1.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-27T14:30:25.064 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-27T14:30:25.065 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-27T14:30:25.066 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.067 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-27T14:30:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T14:30:25.069 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-01-27T14:30:25.070 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-27T14:30:25.070 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-27T14:30:25.070 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-27T14:30:25.070 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-27T14:30:25.070 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-27T14:30:25.071 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-27T14:30:25.071 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:25.071 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-01-27T14:30:25.672 DEBUG:teuthology.parallel:result is None 2024-01-27T14:30:25.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:30:25.814 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-27T14:30:25.835 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-880.g99a21c3b.el9 2024-01-27T14:30:25.835 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-880.g99a21c3b.el9 2024-01-27T14:30:25.836 INFO:teuthology.task.install:The correct ceph version 19.0.0-880.g99a21c3b is installed. 2024-01-27T14:30:25.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:30:26.051 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-27T14:30:26.077 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-880.g99a21c3b.el9 2024-01-27T14:30:26.078 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-880.g99a21c3b.el9 2024-01-27T14:30:26.078 INFO:teuthology.task.install:The correct ceph version 19.0.0-880.g99a21c3b is installed. 2024-01-27T14:30:26.080 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-27T14:30:26.080 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:26.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-27T14:30:26.111 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:26.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-27T14:30:26.151 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-27T14:30:26.151 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:26.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-01-27T14:30:26.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-27T14:30:26.247 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:26.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-01-27T14:30:26.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-27T14:30:26.345 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-27T14:30:26.346 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:26.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-27T14:30:26.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-27T14:30:26.439 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:26.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-27T14:30:26.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-27T14:30:26.535 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-27T14:30:26.536 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:26.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-01-27T14:30:26.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-27T14:30:26.629 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:26.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-01-27T14:30:26.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-27T14:30:26.724 INFO:teuthology.run_tasks:Running task ceph... 2024-01-27T14:30:26.812 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-27T14:30:26.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-01-27T14:30:26.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-01-27T14:30:26.842 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-27T14:30:26.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-27T14:30:26.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-27T14:30:26.908 INFO:tasks.ceph:Creating extra log directories... 2024-01-27T14:30:26.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-27T14:30:26.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-27T14:30:26.981 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-27T14:30:26.981 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-27T14:30:26.982 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-27T14:30:26.982 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:26.982 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-27T14:30:27.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:27.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:27.170 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:27.170 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-27T14:30:27.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:27.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:27.335 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-27T14:30:27.335 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-27T14:30:27.335 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7534528', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4613, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu/zqIZRBFg3jp2A+Ufv+qjoMhSjPz03v7LvvtAVKnmEO2mjp7B1iuDNtezGLOzuLi6c/O9wg94epW1vuIk0f8=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdEBJQmefarsjgSOccQldjMza8K92XAI0BWDP44GlKV+4iAQNyG015M92vcgO5zbF4gOApWiYROHiqIfxZy17w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-26_15:05:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-27T14:30:27.336 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-27T14:30:27.338 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-27T14:30:27.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-01-27T14:30:27.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-01-27T14:30:27.453 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:27.453 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-01-27T14:30:27.471 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-27T14:30:27.472 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 808 Links: 1 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 14:30:13.628078829 +0000 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 14:21:37.147678495 +0000 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 14:21:37.147678495 +0000 2024-01-27T14:30:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 14:21:37.147678495 +0000 2024-01-27T14:30:27.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-27T14:30:27.590 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T14:30:27.591 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T14:30:27.591 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.3585e-05 s, 5.5 MB/s 2024-01-27T14:30:27.592 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-27T14:30:27.647 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-01-27T14:30:27.701 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-27T14:30:27.701 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:27.701 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 827 Links: 1 2024-01-27T14:30:27.701 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:27.702 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:27.702 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 14:30:13.628078829 +0000 2024-01-27T14:30:27.702 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 14:21:37.602673079 +0000 2024-01-27T14:30:27.702 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 14:21:37.602673079 +0000 2024-01-27T14:30:27.702 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 14:21:37.602673079 +0000 2024-01-27T14:30:27.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-27T14:30:27.766 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T14:30:27.766 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T14:30:27.766 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 7.4023e-05 s, 6.9 MB/s 2024-01-27T14:30:27.767 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-27T14:30:27.822 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-01-27T14:30:27.876 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-27T14:30:27.876 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:27.876 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 846 Links: 1 2024-01-27T14:30:27.876 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:27.876 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:27.877 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 14:30:13.628078829 +0000 2024-01-27T14:30:27.877 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 14:21:37.931669162 +0000 2024-01-27T14:30:27.877 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 14:21:37.931669162 +0000 2024-01-27T14:30:27.877 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 14:21:37.931669162 +0000 2024-01-27T14:30:27.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-27T14:30:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T14:30:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T14:30:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 7.4529e-05 s, 6.9 MB/s 2024-01-27T14:30:27.942 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-27T14:30:27.996 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 864 Links: 1 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 14:30:13.629078818 +0000 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 14:21:38.274665080 +0000 2024-01-27T14:30:28.051 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 14:21:38.274665080 +0000 2024-01-27T14:30:28.052 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 14:21:38.274665080 +0000 2024-01-27T14:30:28.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-27T14:30:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T14:30:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T14:30:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.2843e-05 s, 5.5 MB/s 2024-01-27T14:30:28.116 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-27T14:30:28.172 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:28.172 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:28.172 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-01-27T14:30:28.188 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-27T14:30:28.188 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-01-27 14:29:26.684792081 +0000 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-01-27 14:21:26.510763739 +0000 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-01-27 14:21:26.510763739 +0000 2024-01-27T14:30:28.244 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-01-27 14:21:26.510763739 +0000 2024-01-27T14:30:28.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-27T14:30:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-01-27T14:30:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-01-27T14:30:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000191934 s, 2.7 MB/s 2024-01-27T14:30:28.311 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-27T14:30:28.368 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-01-27T14:30:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-27T14:30:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:28.423 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-01-27T14:30:28.423 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:28.423 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:28.424 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-01-27 14:29:26.685792057 +0000 2024-01-27T14:30:28.424 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-01-27 14:21:26.846755256 +0000 2024-01-27T14:30:28.424 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-01-27 14:21:26.846755256 +0000 2024-01-27T14:30:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-01-27 14:21:26.846755256 +0000 2024-01-27T14:30:28.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-27T14:30:28.489 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-01-27T14:30:28.489 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-01-27T14:30:28.489 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000193573 s, 2.6 MB/s 2024-01-27T14:30:28.490 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-27T14:30:28.546 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-01-27 14:29:26.685792057 +0000 2024-01-27T14:30:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-01-27 14:21:27.183746749 +0000 2024-01-27T14:30:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-01-27 14:21:27.183746749 +0000 2024-01-27T14:30:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-01-27 14:21:27.183746749 +0000 2024-01-27T14:30:28.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-27T14:30:28.665 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-01-27T14:30:28.666 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-01-27T14:30:28.666 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000168416 s, 3.0 MB/s 2024-01-27T14:30:28.667 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-27T14:30:28.722 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T14:30:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-01-27 14:29:26.686792033 +0000 2024-01-27T14:30:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-01-27 14:21:27.514738392 +0000 2024-01-27T14:30:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-01-27 14:21:27.514738392 +0000 2024-01-27T14:30:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-01-27 14:21:27.514738392 +0000 2024-01-27T14:30:28.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-27T14:30:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-01-27T14:30:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-01-27T14:30:28.846 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000194489 s, 2.6 MB/s 2024-01-27T14:30:28.847 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-27T14:30:28.903 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:28.903 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-27T14:30:28.903 INFO:tasks.ceph:Generating config... 2024-01-27T14:30:28.904 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-27T14:30:28.904 INFO:tasks.ceph:[client] debug client = 20 2024-01-27T14:30:28.904 INFO:tasks.ceph:[client] debug ms = 1 2024-01-27T14:30:28.904 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-27T14:30:28.905 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-27T14:30:28.905 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-27T14:30:28.905 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-27T14:30:28.905 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-27T14:30:28.905 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-27T14:30:28.906 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-27T14:30:28.906 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-27T14:30:28.907 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-27T14:30:28.907 INFO:tasks.ceph:Setting up mon.a... 2024-01-27T14:30:28.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-27T14:30:28.972 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-01-27T14:30:28.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-27T14:30:29.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T14:30:29.045 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]')] 2024-01-27T14:30:29.046 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-27T14:30:29.047 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:29.047 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-27T14:30:29.101 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:29.186 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:29.186 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 00cf821c-af7b-4286-9602-7ecfadc2291e 2024-01-27T14:30:29.186 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-01-27T14:30:29.186 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-01-27T14:30:29.186 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 00cf821c-af7b-4286-9602-7ecfadc2291e 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-01-27T14:30:29.192013+0000 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-01-27T14:30:29.192013+0000 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-01-27T14:30:29.187 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-27T14:30:29.188 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-27T14:30:29.203 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 00cf821c-af7b-4286-9602-7ecfadc2291e... 2024-01-27T14:30:29.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-27T14:30:29.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-27T14:30:29.292 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-01-27T14:30:29.292 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-01-27T14:30:29.292 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-01-27T14:30:29.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-27T14:30:29.294 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mds beacon grace = 60 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: mds heartbeat grace = 60 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: osd heartbeat grace = 60 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 00cf821c-af7b-4286-9602-7ecfadc2291e 2024-01-27T14:30:29.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-01-27T14:30:29.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-01-27T14:30:29.297 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 20 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 20 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 10 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: osd fast shutdown = False 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-01-27T14:30:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-01-27T14:30:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-01-27T14:30:29.300 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd crush smoke test = False 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-27T14:30:29.301 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-01-27T14:30:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: mds valgrind exit = True 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-27T14:30:29.303 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-27T14:30:29.304 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-01-27T14:30:29.305 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.46,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mds beacon grace = 60 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: mds heartbeat grace = 60 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: osd heartbeat grace = 60 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 00cf821c-af7b-4286-9602-7ecfadc2291e 2024-01-27T14:30:29.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.307 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-01-27T14:30:29.308 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: osd fast shutdown = False 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-01-27T14:30:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-01-27T14:30:29.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-01-27T14:30:29.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd crush smoke test = False 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-01-27T14:30:29.312 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-01-27T14:30:29.313 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: mds valgrind exit = True 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-01-27T14:30:29.314 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-01-27T14:30:29.315 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-27T14:30:29.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-27T14:30:29.410 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-27T14:30:29.410 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:29.410 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-27T14:30:29.425 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:29.425 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-27T14:30:29.479 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:30:29.479 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:29.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-27T14:30:29.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T14:30:29.557 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:29.557 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:29.612 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:30:29.613 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:29.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-27T14:30:29.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T14:30:29.652 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:29.653 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:29.707 INFO:tasks.ceph:Setting up mon nodes... 2024-01-27T14:30:29.708 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-27T14:30:29.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-27T14:30:29.762 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-27T14:30:29.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-27T14:30:29.824 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-27T14:30:29.827 INFO:tasks.ceph:Setting up mds nodes... 2024-01-27T14:30:29.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-27T14:30:29.881 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-27T14:30:29.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-27T14:30:29.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-27T14:30:30.005 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-27T14:30:30.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-27T14:30:30.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-27T14:30:30.128 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-27T14:30:30.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-27T14:30:30.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-27T14:30:30.211 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-27T14:30:30.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-27T14:30:30.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-27T14:30:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-27T14:30:30.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-27T14:30:30.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-27T14:30:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-27T14:30:30.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-27T14:30:30.487 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-27T14:30:30.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-27T14:30:30.531 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-27T14:30:30.546 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-27T14:30:30.546 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-27T14:30:30.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-27T14:30:30.612 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:30.612 INFO:tasks.ceph:role: osd.0 2024-01-27T14:30:30.612 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:30:30.612 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:30.678 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:30.679 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:30.679 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:30.710 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T14:30:30.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T14:30:30.712 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-27T14:30:30.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-27T14:30:30.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-27T14:30:30.921 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:30.921 INFO:tasks.ceph:role: osd.1 2024-01-27T14:30:30.922 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:30:30.922 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-27T14:30:30.988 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:30.988 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:30.988 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:30.988 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:31.021 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T14:30:31.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T14:30:31.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-27T14:30:31.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-27T14:30:31.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-27T14:30:31.231 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:31.231 INFO:tasks.ceph:role: osd.2 2024-01-27T14:30:31.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:30:31.231 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-27T14:30:31.297 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:31.297 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:31.297 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:31.297 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:31.297 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:31.298 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:31.298 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:31.298 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:31.298 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:31.298 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:31.330 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T14:30:31.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T14:30:31.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-27T14:30:31.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-27T14:30:31.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-27T14:30:31.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:31.542 INFO:tasks.ceph:role: osd.3 2024-01-27T14:30:31.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:30:31.542 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:31.608 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:31.609 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:31.609 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:31.641 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T14:30:31.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T14:30:31.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-27T14:30:31.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-27T14:30:31.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.883+0000 7f3d56620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-27T14:30:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.884+0000 7f3d56620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-27T14:30:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.884+0000 7f3d56620640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T14:30:31.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.884+0000 7f3d56620640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T14:30:31.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.884+0000 7f3d56620640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T14:30:31.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:31.884+0000 7f3d56620640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-27T14:30:34.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-27T14:30:34.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.848+0000 7f88c5824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-27T14:30:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.848+0000 7f88c5824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-27T14:30:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.848+0000 7f88c5824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T14:30:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.848+0000 7f88c5824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T14:30:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.848+0000 7f88c5824640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T14:30:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:34.849+0000 7f88c5824640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-27T14:30:37.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-27T14:30:37.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:37.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-27T14:30:37.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-27T14:30:37.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T14:30:37.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T14:30:37.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T14:30:37.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:37.820+0000 7f227c21f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-27T14:30:40.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-27T14:30:40.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.794+0000 7f0ac8193640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.794+0000 7f0ac8193640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.794+0000 7f0ac8193640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.794+0000 7f0ac8193640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.794+0000 7f0ac8193640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T14:30:40.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:30:40.795+0000 7f0ac8193640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-27T14:30:43.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-27T14:30:43.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-27T14:30:43.702 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:43.702 INFO:tasks.ceph:role: osd.4 2024-01-27T14:30:43.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:30:43.702 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:43.780 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:44.285 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-01-27T14:30:44.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-01-27T14:30:44.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-27T14:30:44.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-27T14:30:44.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-27T14:30:44.551 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:44.552 INFO:tasks.ceph:role: osd.5 2024-01-27T14:30:44.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:30:44.552 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:44.628 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:45.093 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-01-27T14:30:45.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-01-27T14:30:45.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-27T14:30:45.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-27T14:30:45.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-27T14:30:45.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:45.311 INFO:tasks.ceph:role: osd.6 2024-01-27T14:30:45.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:30:45.311 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-27T14:30:45.387 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:45.387 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:45.387 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:45.388 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:45.875 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-01-27T14:30:45.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-01-27T14:30:45.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-27T14:30:46.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-27T14:30:46.044 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-27T14:30:46.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T14:30:46.113 INFO:tasks.ceph:role: osd.7 2024-01-27T14:30:46.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T14:30:46.114 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-27T14:30:46.190 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T14:30:46.190 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T14:30:46.190 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T14:30:46.191 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T14:30:46.696 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-01-27T14:30:46.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-01-27T14:30:46.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-27T14:30:46.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-27T14:30:46.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-27T14:30:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-27T14:30:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T14:30:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T14:30:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T14:30:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:46.963+0000 7fbeb460e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-27T14:30:49.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-27T14:30:49.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.945+0000 7f27da00f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-27T14:30:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.945+0000 7f27da00f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-27T14:30:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.945+0000 7f27da00f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T14:30:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.945+0000 7f27da00f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T14:30:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.945+0000 7f27da00f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T14:30:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:49.946+0000 7f27da00f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-27T14:30:52.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-27T14:30:52.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:52.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.919+0000 7f74216ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-27T14:30:52.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.919+0000 7f74216ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-27T14:30:52.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.919+0000 7f74216ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T14:30:52.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.919+0000 7f74216ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T14:30:52.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.919+0000 7f74216ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T14:30:52.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:52.920+0000 7f74216ae640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-27T14:30:55.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-27T14:30:55.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:30:55.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.892+0000 7f44f961b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-27T14:30:55.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.893+0000 7f44f961b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-27T14:30:55.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.893+0000 7f44f961b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T14:30:55.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.893+0000 7f44f961b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T14:30:55.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.893+0000 7f44f961b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T14:30:55.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:30:55.893+0000 7f44f961b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-27T14:30:57.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:57.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:30:58.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-27T14:30:58.770 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-27T14:30:58.770 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:58.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-27T14:30:58.801 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:58.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-27T14:30:58.871 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:58.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-27T14:30:58.942 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:58.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-27T14:30:59.011 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:59.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-27T14:30:59.079 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:59.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-27T14:30:59.148 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:59.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-27T14:30:59.215 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:59.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-27T14:30:59.283 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-27T14:30:59.314 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-27T14:30:59.385 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-27T14:30:59.455 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-27T14:30:59.523 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-27T14:30:59.592 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-27T14:30:59.660 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-27T14:30:59.730 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:30:59.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-27T14:30:59.799 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:30:59.799 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-27T14:30:59.817 INFO:tasks.ceph:Adding keys to all mons... 2024-01-27T14:30:59.817 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-27T14:30:59.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-27T14:30:59.886 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-01-27T14:30:59.886 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCFE7VlvCLILRAAnZNs6cJWMqlbcmaaQolB3Q== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCFE7VlBBboNBAAqecqSeZEPeEhBVnU05+sOw== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7Vl0X6iABAAnKpa0HRB+1dKWSL1i9227A== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7VlaO79BxAAWfzHO26d9hFNioU6AUjxSQ== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCHE7Vlv0jKNBAAJrCnD0wizyqzCmlMrAtHBg== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCKE7VlFr6wMhAAsb/Gvoq46W757PigNb3umg== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCNE7VlmGf8MBAAAO111HYqX+5uCRiYH9TgYg== 2024-01-27T14:30:59.887 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCQE7VlciNnLxAA0yBwGA0UShdX8sidC7SgAw== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCFE7VlLLB5MRAAsXNxkSrQNnz957Be3yWX6w== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7VlMYv0DBAAVz0rGWRUtkBR2oBDp244wA== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7VldLtRFBAAYyZTlDYMB6iByz+7qtsm3g== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7Vl2p+pGxAAc3i6xO2qzSyE3IPJSHG5xA== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCWE7VlG2V8ORAAdKnl7wg/hhPhWCbLphnD9A== 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-01-27T14:30:59.888 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCZE7Vl1jBtOBAAusf//ZO4CM0h6SoJd/Vrow== 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcE7Vl0+nhNhAAjiodRyZKYdJ/tYQfOk9amA== 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCfE7Vl9CVONRAA0anjaO8wLO3XH4J0rEQQ2A== 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-01-27T14:30:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGE7Vlk7v8HxAAvh1gWAnHAMjs0kvF30AKLQ== 2024-01-27T14:30:59.890 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCFE7VlvCLILRAAnZNs6cJWMqlbcmaaQolB3Q== 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCFE7VlBBboNBAAqecqSeZEPeEhBVnU05+sOw== 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7Vl0X6iABAAnKpa0HRB+1dKWSL1i9227A== 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7VlaO79BxAAWfzHO26d9hFNioU6AUjxSQ== 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCHE7Vlv0jKNBAAJrCnD0wizyqzCmlMrAtHBg== 2024-01-27T14:30:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCKE7VlFr6wMhAAsb/Gvoq46W757PigNb3umg== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCNE7VlmGf8MBAAAO111HYqX+5uCRiYH9TgYg== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCQE7VlciNnLxAA0yBwGA0UShdX8sidC7SgAw== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCFE7VlLLB5MRAAsXNxkSrQNnz957Be3yWX6w== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7VlMYv0DBAAVz0rGWRUtkBR2oBDp244wA== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7VldLtRFBAAYyZTlDYMB6iByz+7qtsm3g== 2024-01-27T14:30:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7Vl2p+pGxAAc3i6xO2qzSyE3IPJSHG5xA== 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCWE7VlG2V8ORAAdKnl7wg/hhPhWCbLphnD9A== 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCZE7Vl1jBtOBAAusf//ZO4CM0h6SoJd/Vrow== 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcE7Vl0+nhNhAAjiodRyZKYdJ/tYQfOk9amA== 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCfE7Vl9CVONRAA0anjaO8wLO3XH4J0rEQQ2A== 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-01-27T14:30:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCGE7Vlk7v8HxAAvh1gWAnHAMjs0kvF30AKLQ== 2024-01-27T14:30:59.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T14:30:59.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T14:30:59.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:30:59.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T14:31:00.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T14:31:00.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T14:31:00.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T14:31:00.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-27T14:31:00.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-27T14:31:00.873 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-27T14:31:00.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-27T14:31:00.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T14:31:00.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-27T14:31:01.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-27T14:31:01.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T14:31:01.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-27T14:31:01.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-27T14:31:01.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T14:31:01.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-27T14:31:01.367 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:31:01.370 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-27T14:31:01.423 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-27T14:31:01.423 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T14:31:01.423 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-27T14:31:01.424 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-27T14:31:01.427 INFO:tasks.ceph.mon.a:Started 2024-01-27T14:31:01.427 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T14:31:01.427 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-27T14:31:01.427 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-27T14:31:01.466 INFO:tasks.ceph.mon.b:Started 2024-01-27T14:31:01.466 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T14:31:01.466 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-27T14:31:01.466 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-27T14:31:01.468 INFO:tasks.ceph.mon.c:Started 2024-01-27T14:31:01.468 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-27T14:31:01.468 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-27T14:31:01.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-27T14:31:01.470 INFO:tasks.ceph.mgr.y:Started 2024-01-27T14:31:01.470 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-27T14:31:01.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-27T14:31:01.472 INFO:tasks.ceph.mgr.x:Started 2024-01-27T14:31:01.472 INFO:tasks.ceph:Setting crush tunables to default 2024-01-27T14:31:01.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-01-27T14:31:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.579+0000 7fc90302b640 1 Processor -- start 2024-01-27T14:31:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.579+0000 7fc90302b640 1 -- start start 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc90302b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc90302b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0c87f0 con 0x7fc8fc0cca70 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc90302b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc1586e0 con 0x7fc8fc0c4b30 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc90302b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7630 con 0x7fc8fc151980 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 msgr2=0x7fc8fc1581a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8fc0cca70 legacy=0x7fc8fc06a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.580+0000 7fc9015c8640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fc8fc0c4b30 legacy=0x7fc8fc0c4f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-01-27T14:31:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.781+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 msgr2=0x7fc8fc1581a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.781+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8fc0cca70 legacy=0x7fc8fc06a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.781+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:01.781+0000 7fc9015c8640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fc8fc0c4b30 legacy=0x7fc8fc0c4f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-01-27T14:31:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.182+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 msgr2=0x7fc8fc1581a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.182+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8fc0cca70 legacy=0x7fc8fc06a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.182+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.182+0000 7fc9015c8640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fc8fc0c4b30 legacy=0x7fc8fc0c4f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-01-27T14:31:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.983+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 msgr2=0x7fc8fc1581a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.983+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8fc0cca70 legacy=0x7fc8fc06a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.983+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:02.983+0000 7fc9015c8640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fc8fc0c4b30 legacy=0x7fc8fc0c4f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 msgr2=0x7fc8fc1581a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8fc151980 0x7fc8fc1581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fc8fc0c4b30 legacy=0x7fc8fc0c4f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8fc0cca70 legacy=0x7fc8fc06a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7630 con 0x7fc8e00036a0 2024-01-27T14:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fa7fc640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0008ca0 con 0x7fc8e0006110 2024-01-27T14:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc900dc7640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 msgr2=0x7fc8e0005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fbfff640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 msgr2=0x7fc8e00085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-01-27T14:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc900dc7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.580+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.781+0000 7fc900dc7640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 msgr2=0x7fc8e0005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.781+0000 7fc8fbfff640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 msgr2=0x7fc8e00085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-01-27T14:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.781+0000 7fc900dc7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:04.781+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.182+0000 7fc900dc7640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 msgr2=0x7fc8e0005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.182+0000 7fc8fbfff640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 msgr2=0x7fc8e00085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-01-27T14:31:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.182+0000 7fc900dc7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.182+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.983+0000 7fc900dc7640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 msgr2=0x7fc8e0005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.983+0000 7fc8fbfff640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 msgr2=0x7fc8e00085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3301/0 2024-01-27T14:31:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.983+0000 7fc900dc7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:05.983+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 -- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 msgr2=0x7fc8e00085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0006110 0x7fc8e00085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 msgr2=0x7fc8e0005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00036a0 0x7fc8e0005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc9015c8640 1 -- reap_dead start 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0c7900 con 0x7fc8e0006b00 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 msgr2=0x7fc8e00065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7630 con 0x7fc8e0003b10 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fa7fc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e0008ca0 con 0x7fc8e00086f0 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8e0006b00 legacy=0x7fc8e0006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc9015c8640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 msgr2=0x7fc8e000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.580+0000 7fc9015c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.781+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 msgr2=0x7fc8e00065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.781+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8e0006b00 legacy=0x7fc8e0006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.781+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.781+0000 7fc9015c8640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 msgr2=0x7fc8e000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:07.781+0000 7fc9015c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.182+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 msgr2=0x7fc8e00065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.182+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8e0006b00 legacy=0x7fc8e0006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.182+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.182+0000 7fc9015c8640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 msgr2=0x7fc8e000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:08.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.182+0000 7fc9015c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:08.698 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:00:07.111 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:08.698 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:00:07.112 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:08.778 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:07.241 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.983+0000 7fc900dc7640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 msgr2=0x7fc8e00065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T14:31:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.983+0000 7fc8fbfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8e0006b00 legacy=0x7fc8e0006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T14:31:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.983+0000 7fc900dc7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.983+0000 7fc9015c8640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 msgr2=0x7fc8e000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-01-27T14:31:08.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:08.983+0000 7fc9015c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:09.018 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:00:07.431 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:09.019 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:00:07.432 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:09.105 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:07.568 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:31:10.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 msgr2=0x7fc8e000d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:10.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8e00086f0 0x7fc8e000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 msgr2=0x7fc8e00065c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc8e0003b10 0x7fc8e00065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fc8e0006b00 legacy=0x7fc8e0006f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0c87f0 con 0x7fc8e000d780 2024-01-27T14:31:10.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.580+0000 7fc8fa7fc640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7630 con 0x7fc8e000e340 2024-01-27T14:31:10.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.634+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.650+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48838/0 (socket says 172.21.15.46:48838) 2024-01-27T14:31:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.650+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 learned_addr learned my addr 172.21.15.46:0/1900606363 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.684+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T14:31:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.684+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.684+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:10.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:10.684+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:11.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.186+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:11.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.423+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T14:31:11.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.423+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:11.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.423+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:11.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.423+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:11.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.824+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.826+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T14:31:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.826+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.826+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:11.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:11.826+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T14:31:12.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:12.628+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:12.629+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T14:31:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:12.629+0000 7fc8fbfff640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:12.629+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:12.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:12.629+0000 7fc8fbfff640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 msgr2=0x7fc8e0013910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e000e340 0x7fc8e0013910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 -- 172.21.15.46:0/1900606363 >> v1:172.21.15.73:6789/0 conn(0x7fc8e000d780 legacy=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 reap_dead start 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.580+0000 7fc8fa7fc640 1 -- 172.21.15.46:0/1900606363 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0c7900 con 0x7fc8e0013ff0 2024-01-27T14:31:13.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.581+0000 7fc8fa7fc640 1 -- 172.21.15.46:0/1900606363 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7630 con 0x7fc8e0005ac0 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.581+0000 7fc8fa7fc640 1 -- 172.21.15.46:0/1900606363 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0008ca0 con 0x7fc8e00065c0 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.581+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.583+0000 7fc900dc7640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 msgr2=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.583+0000 7fc900dc7640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 msgr2=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.583+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.583+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:13.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.638+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.683+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 msgr2=0x7fc8e000cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-27T14:31:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.683+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 msgr2=0x7fc8e000cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.683+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:13.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.683+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T14:31:13.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.819+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:13.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.897+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.901+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 msgr2=0x7fc8e000cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-27T14:31:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.901+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 msgr2=0x7fc8e000cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.901+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.901+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:13.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.940+0000 7fc900dc7640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 msgr2=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T14:31:13.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.940+0000 7fc900dc7640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 msgr2=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T14:31:13.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.940+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T14:31:13.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:13.940+0000 7fc900dc7640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T14:31:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.153+0000 7fc8fb7fe640 1 -- 172.21.15.46:0/1900606363 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469175201 0 0) 0x7fc8fc0c7900 con 0x7fc8e0013ff0 2024-01-27T14:31:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.153+0000 7fc8fb7fe640 1 -- 172.21.15.46:0/1900606363 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ec003520 con 0x7fc8e0013ff0 2024-01-27T14:31:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.312+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> v2:172.21.15.46:3300/0 conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.320+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 msgr2=0x7fc8e000db90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T14:31:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.320+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.320+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 >> v1:172.21.15.73:6789/0 conn(0x7fc8e0013ff0 legacy=0x7fc8e00143f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.320+0000 7fc9015c8640 1 -- 172.21.15.46:0/1900606363 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc1586e0 con 0x7fc8e0005ac0 2024-01-27T14:31:14.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.322+0000 7fc9015c8640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0005ac0 0x7fc8e000cfe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc06cb10 tx=0x7fc8f402c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4949e313fecdbd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:14.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.329+0000 7fc8fb7fe640 1 -- 172.21.15.46:0/1900606363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f402cb10 con 0x7fc8e0005ac0 2024-01-27T14:31:14.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.329+0000 7fc8fb7fe640 1 -- 172.21.15.46:0/1900606363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f402cc70 con 0x7fc8e0005ac0 2024-01-27T14:31:14.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.329+0000 7fc8fb7fe640 1 -- 172.21.15.46:0/1900606363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400b400 con 0x7fc8e0005ac0 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 -- 172.21.15.46:0/1900606363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0005ac0 msgr2=0x7fc8e000cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0005ac0 0x7fc8e000cfe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc06cb10 tx=0x7fc8f402c170 comp rx=0 tx=0).stop 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 -- 172.21.15.46:0/1900606363 shutdown_connections 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0005ac0 0x7fc8e000cfe0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 --2- 172.21.15.46:0/1900606363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e00065c0 0x7fc8e000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 -- 172.21.15.46:0/1900606363 >> 172.21.15.46:0/1900606363 conn(0x7fc8fc0cbf80 msgr2=0x7fc8fc0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 -- 172.21.15.46:0/1900606363 shutdown_connections 2024-01-27T14:31:14.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.330+0000 7fc90302b640 1 -- 172.21.15.46:0/1900606363 wait complete. 2024-01-27T14:31:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.331+0000 7fc90302b640 1 Processor -- start 2024-01-27T14:31:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.331+0000 7fc90302b640 1 -- start start 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0005ac0 0x7fc8fc1eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8e00065c0 0x7fc8fc14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc156520 con 0x7fc8e0013ff0 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc156800 con 0x7fc8e00065c0 2024-01-27T14:31:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc90302b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc156ae0 con 0x7fc8e0005ac0 2024-01-27T14:31:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.332+0000 7fc9015c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.333+0000 7fc9015c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45774/0 (socket says 172.21.15.46:45774) 2024-01-27T14:31:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.333+0000 7fc9015c8640 1 -- 172.21.15.46:0/3751467848 learned_addr learned my addr 172.21.15.46:0/3751467848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:14.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.344+0000 7fc9015c8640 1 -- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0005ac0 msgr2=0x7fc8fc1eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:14.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.344+0000 7fc9015c8640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0005ac0 0x7fc8fc1eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.344+0000 7fc9015c8640 1 -- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8e00065c0 msgr2=0x7fc8fc14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:14.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.344+0000 7fc9015c8640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8e00065c0 0x7fc8fc14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.344+0000 7fc9015c8640 1 -- 172.21.15.46:0/3751467848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f400d9f0 con 0x7fc8e0013ff0 2024-01-27T14:31:14.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.346+0000 7fc9015c8640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0673c0 tx=0x7fc8f4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:14.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.350+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f403a070 con 0x7fc8e0013ff0 2024-01-27T14:31:14.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.350+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f403e410 con 0x7fc8e0013ff0 2024-01-27T14:31:14.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.350+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc0c7770 con 0x7fc8e0013ff0 2024-01-27T14:31:14.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.350+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f402cb10 con 0x7fc8e0013ff0 2024-01-27T14:31:14.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.350+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc1570a0 con 0x7fc8e0013ff0 2024-01-27T14:31:14.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.351+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc0742e0 con 0x7fc8e0013ff0 2024-01-27T14:31:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.544+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc8f403e7e0 con 0x7fc8e0013ff0 2024-01-27T14:31:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.544+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc8f4047800 con 0x7fc8e0013ff0 2024-01-27T14:31:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.544+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fc8f40343f0 con 0x7fc8e0013ff0 2024-01-27T14:31:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.612+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc8fc0c7200 con 0x7fc8e0013ff0 2024-01-27T14:31:14.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.771+0000 7fc8f97fa640 1 -- 172.21.15.46:0/3751467848 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc8f403ec70 con 0x7fc8e0013ff0 2024-01-27T14:31:14.767 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 msgr2=0x7fc8fc1578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0673c0 tx=0x7fc8f4000f40 comp rx=0 tx=0).stop 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 shutdown_connections 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8e00065c0 0x7fc8fc14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8e0013ff0 0x7fc8fc1578a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 --2- 172.21.15.46:0/3751467848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8e0005ac0 0x7fc8fc1eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 >> 172.21.15.46:0/3751467848 conn(0x7fc8fc0cbf80 msgr2=0x7fc8fc150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 shutdown_connections 2024-01-27T14:31:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:14.772+0000 7fc90302b640 1 -- 172.21.15.46:0/3751467848 wait complete. 2024-01-27T14:31:14.778 INFO:tasks.ceph:check_enable_crimson: False 2024-01-27T14:31:14.778 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-27T14:31:14.779 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:31:14.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-27T14:31:14.806 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:31:14.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-27T14:31:14.830 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:14.834+0000 7f1ecf02c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-27T14:31:14.857 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:31:14.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-27T14:31:14.889 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:14.893+0000 7f1ecf02c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-27T14:31:14.915 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:31:14.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-27T14:31:14.942 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:14.946+0000 7f5113431040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-27T14:31:14.983 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:31:14.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-27T14:31:14.997 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.002+0000 7f5113431040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-27T14:31:15.011 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:31:15.011 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-27T14:31:15.079 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:31:15.079 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-27T14:31:15.147 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-01-27T14:31:15.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-27T14:31:15.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 05ee0cd1-394a-44de-9fed-1d79720d58cd 0 2024-01-27T14:31:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.389+0000 7fb16c40e640 1 Processor -- start 2024-01-27T14:31:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.389+0000 7fb16c40e640 1 -- start start 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.390+0000 7fb16c40e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb16415d200 0x7fb16415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.390+0000 7fb16c40e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16415cd50 con 0x7fb164153930 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.390+0000 7fb16c40e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16415dbb0 con 0x7fb1640ca340 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.390+0000 7fb16c40e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16406d3f0 con 0x7fb16415d200 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.391+0000 7fb16a9ab640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb16415d200 0x7fb16415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.391+0000 7fb1699a9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1640ca340 0x7fb164070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56468/0 (socket says 172.21.15.73:56468) 2024-01-27T14:31:15.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.391+0000 7fb1699a9640 1 -- 172.21.15.73:0/3060872597 learned_addr learned my addr 172.21.15.73:0/3060872597 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-01-27T14:31:15.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.394+0000 7fb1691a8640 1 -- 172.21.15.73:0/3060872597 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569821271 0 0) 0x7fb16415dbb0 con 0x7fb1640ca340 2024-01-27T14:31:15.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.394+0000 7fb1691a8640 1 -- 172.21.15.73:0/3060872597 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb150003520 con 0x7fb1640ca340 2024-01-27T14:31:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.395+0000 7fb16a9ab640 1 -- 172.21.15.73:0/3060872597 >> v1:172.21.15.73:6789/0 conn(0x7fb1640ca340 legacy=0x7fb164070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.395+0000 7fb16a9ab640 1 -- 172.21.15.73:0/3060872597 >> v1:172.21.15.46:6789/0 conn(0x7fb164153930 legacy=0x7fb1640c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.395+0000 7fb16a9ab640 1 -- 172.21.15.73:0/3060872597 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640c9580 con 0x7fb16415d200 2024-01-27T14:31:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.398+0000 7fb16a9ab640 1 --2- 172.21.15.73:0/3060872597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16415d200 0x7fb16415d670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009d90 tx=0x7fb15c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e29bfbcb5309b3b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:15.432 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.436+0000 7f1ecf02c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-27T14:31:15.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.481+0000 7fb1691a8640 1 -- 172.21.15.73:0/3060872597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c02cd80 con 0x7fb16415d200 2024-01-27T14:31:15.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.481+0000 7fb1691a8640 1 -- 172.21.15.73:0/3060872597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c034440 con 0x7fb16415d200 2024-01-27T14:31:15.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.481+0000 7fb1691a8640 1 -- 172.21.15.73:0/3060872597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0347d0 con 0x7fb16415d200 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 -- 172.21.15.73:0/3060872597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16415d200 msgr2=0x7fb16415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 --2- 172.21.15.73:0/3060872597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16415d200 0x7fb16415d670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009d90 tx=0x7fb15c02bfd0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 -- 172.21.15.73:0/3060872597 shutdown_connections 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 --2- 172.21.15.73:0/3060872597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16415d200 0x7fb16415d670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 -- 172.21.15.73:0/3060872597 >> 172.21.15.73:0/3060872597 conn(0x7fb164066c80 msgr2=0x7fb16406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 -- 172.21.15.73:0/3060872597 shutdown_connections 2024-01-27T14:31:15.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.482+0000 7fb16c40e640 1 -- 172.21.15.73:0/3060872597 wait complete. 2024-01-27T14:31:15.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.483+0000 7fb16c40e640 1 Processor -- start 2024-01-27T14:31:15.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.483+0000 7fb16c40e640 1 -- start start 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 0x7fb1641efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb164153930 0x7fb1640c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 0x7fb164150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1641f0070 con 0x7fb164153930 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164157640 con 0x7fb16415d200 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16c40e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16415c380 con 0x7fb1640ca340 2024-01-27T14:31:15.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.484+0000 7fb16a9ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 0x7fb164150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:15.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.485+0000 7fb16a1aa640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 0x7fb1641efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:15.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.485+0000 7fb16a9ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 0x7fb164150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46412/0 (socket says 172.21.15.73:46412) 2024-01-27T14:31:15.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.485+0000 7fb16a9ab640 1 -- 172.21.15.73:0/591972306 learned_addr learned my addr 172.21.15.73:0/591972306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:15.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.487+0000 7fb1699a9640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb164153930 0x7fb1640c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.489+0000 7fb16a1aa640 1 -- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 msgr2=0x7fb164150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.489+0000 7fb16a1aa640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 0x7fb164150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.489+0000 7fb16a1aa640 1 -- 172.21.15.73:0/591972306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb164153930 msgr2=0x7fb1640c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.489+0000 7fb16a1aa640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb164153930 0x7fb1640c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.489+0000 7fb16a1aa640 1 -- 172.21.15.73:0/591972306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c009a70 con 0x7fb1640ca340 2024-01-27T14:31:15.486 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.491+0000 7f1ecf02c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-27T14:31:15.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.491+0000 7fb16a1aa640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 0x7fb1641efb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c340 tx=0x7fb16000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.501+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600052d0 con 0x7fb1640ca340 2024-01-27T14:31:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.501+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160005450 con 0x7fb1640ca340 2024-01-27T14:31:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.501+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160007260 con 0x7fb1640ca340 2024-01-27T14:31:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.501+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16415c660 con 0x7fb1640ca340 2024-01-27T14:31:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.501+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640c42c0 con 0x7fb1640ca340 2024-01-27T14:31:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.502+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640c7620 con 0x7fb1640ca340 2024-01-27T14:31:15.534 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.538+0000 7f1ecf02c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-27T14:31:15.589 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.593+0000 7f1ecf02c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-27T14:31:15.630 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.635+0000 7f5113431040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-27T14:31:15.632 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.636+0000 7f1ecf02c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-27T14:31:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.683+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb1600073c0 con 0x7fb1640ca340 2024-01-27T14:31:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.683+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb160003910 con 0x7fb1640ca340 2024-01-27T14:31:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.683+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fb160020060 con 0x7fb1640ca340 2024-01-27T14:31:15.685 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.689+0000 7f5113431040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-27T14:31:15.731 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.736+0000 7f5113431040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-27T14:31:15.737 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.742+0000 7f1ecf02c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-27T14:31:15.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.755+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "05ee0cd1-394a-44de-9fed-1d79720d58cd", "id": 0} v 0) v1 -- 0x7fb16415cb80 con 0x7fb1640ca340 2024-01-27T14:31:15.786 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.791+0000 7f5113431040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-27T14:31:15.810 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.814+0000 7f1ecf02c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-27T14:31:15.830 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.834+0000 7f5113431040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-27T14:31:15.857 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.862+0000 7f1ecf02c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-27T14:31:15.912 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.916+0000 7f1ecf02c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-27T14:31:15.939 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:15.944+0000 7f5113431040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-27T14:31:15.961 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:15.965+0000 7f1ecf02c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-27T14:31:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.966+0000 7fb15affd640 1 -- 172.21.15.73:0/591972306 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05ee0cd1-394a-44de-9fed-1d79720d58cd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb16415cb80 con 0x7fb1640ca340 2024-01-27T14:31:15.961 INFO:teuthology.orchestra.run.smithi073.stdout:0 2024-01-27T14:31:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 msgr2=0x7fb1641efb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 0x7fb1641efb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c340 tx=0x7fb16000c800 comp rx=0 tx=0).stop 2024-01-27T14:31:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 shutdown_connections 2024-01-27T14:31:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb16415d200 0x7fb164150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb164153930 0x7fb1640c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 --2- 172.21.15.73:0/591972306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1640ca340 0x7fb1641efb30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 >> 172.21.15.73:0/591972306 conn(0x7fb164066c80 msgr2=0x7fb1640c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 shutdown_connections 2024-01-27T14:31:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:15.967+0000 7fb16c40e640 1 -- 172.21.15.73:0/591972306 wait complete. 2024-01-27T14:31:15.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new abfc146b-b77e-4c85-880a-b129f6dd3e0a 1 2024-01-27T14:31:16.016 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.020+0000 7f5113431040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-27T14:31:16.063 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.068+0000 7f5113431040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-27T14:31:16.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.078+0000 7fcd41497640 1 Processor -- start 2024-01-27T14:31:16.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.078+0000 7fcd41497640 1 -- start start 2024-01-27T14:31:16.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.079+0000 7fcd41497640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd3c157520 0x7fcd3c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.079+0000 7fcd41497640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.079+0000 7fcd41497640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c1584c0 con 0x7fcd3c1517f0 2024-01-27T14:31:16.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.079+0000 7fcd41497640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c157970 con 0x7fcd3c157520 2024-01-27T14:31:16.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.079+0000 7fcd41497640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c06df20 con 0x7fcd3c06cfd0 2024-01-27T14:31:16.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.080+0000 7fcd3a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd3c157520 0x7fcd3c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.080+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.080+0000 7fcd3a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd3c157520 0x7fcd3c06ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46426/0 (socket says 172.21.15.73:46426) 2024-01-27T14:31:16.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.080+0000 7fcd3a7fc640 1 -- 172.21.15.73:0/1277371036 learned_addr learned my addr 172.21.15.73:0/1277371036 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:16.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.083+0000 7fcd3a7fc640 1 -- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 msgr2=0x7fcd3c0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:16.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.083+0000 7fcd3a7fc640 1 --2- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.083+0000 7fcd3a7fc640 1 -- 172.21.15.73:0/1277371036 >> v1:172.21.15.73:6789/0 conn(0x7fcd3c1517f0 legacy=0x7fcd3c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:16.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.083+0000 7fcd3a7fc640 1 -- 172.21.15.73:0/1277371036 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c157c20 con 0x7fcd3c157520 2024-01-27T14:31:16.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.084+0000 7fcd3a7fc640 1 --2- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c06ca90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009870 tx=0x7fcd3002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af09c12216a8fa90 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:16.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.092+0000 7fcd39ffb640 1 -- 172.21.15.73:0/1277371036 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30031640 con 0x7fcd3c157520 2024-01-27T14:31:16.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.092+0000 7fcd39ffb640 1 -- 172.21.15.73:0/1277371036 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300317a0 con 0x7fcd3c157520 2024-01-27T14:31:16.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.092+0000 7fcd39ffb640 1 -- 172.21.15.73:0/1277371036 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30031b30 con 0x7fcd3c157520 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 -- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 msgr2=0x7fcd3c06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 --2- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c06ca90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009870 tx=0x7fcd3002b8f0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 -- 172.21.15.73:0/1277371036 shutdown_connections 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 --2- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 --2- 172.21.15.73:0/1277371036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c06ca90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 -- 172.21.15.73:0/1277371036 >> 172.21.15.73:0/1277371036 conn(0x7fcd3c0c7a00 msgr2=0x7fcd3c0c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 -- 172.21.15.73:0/1277371036 shutdown_connections 2024-01-27T14:31:16.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.093+0000 7fcd41497640 1 -- 172.21.15.73:0/1277371036 wait complete. 2024-01-27T14:31:16.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.095+0000 7fcd41497640 1 Processor -- start 2024-01-27T14:31:16.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.095+0000 7fcd41497640 1 -- start start 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.096+0000 7fcd41497640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd41497640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c1517f0 0x7fcd3c1e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd41497640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd41497640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c14b1c0 con 0x7fcd3c1517f0 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd41497640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c14de60 con 0x7fcd3c157520 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd41497640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0c04f0 con 0x7fcd3c06cfd0 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd3affd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd3a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c1517f0 0x7fcd3c1e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46434/0 (socket says 172.21.15.73:46434) 2024-01-27T14:31:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.097+0000 7fcd3b7fe640 1 -- 172.21.15.73:0/2998991417 learned_addr learned my addr 172.21.15.73:0/2998991417 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.101+0000 7fcd3b7fe640 1 -- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 msgr2=0x7fcd3c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.101+0000 7fcd3b7fe640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.101+0000 7fcd3b7fe640 1 -- 172.21.15.73:0/2998991417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c1517f0 msgr2=0x7fcd3c1e19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.101+0000 7fcd3b7fe640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c1517f0 0x7fcd3c1e19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.101+0000 7fcd3b7fe640 1 -- 172.21.15.73:0/2998991417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300094d0 con 0x7fcd3c157520 2024-01-27T14:31:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.104+0000 7fcd3b7fe640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400efc0 tx=0x7fcd3400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.110+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34009ba0 con 0x7fcd3c157520 2024-01-27T14:31:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.110+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3400f040 con 0x7fcd3c157520 2024-01-27T14:31:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.110+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c0c0a20 con 0x7fcd3c157520 2024-01-27T14:31:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.110+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340146c0 con 0x7fcd3c157520 2024-01-27T14:31:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.110+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c1552f0 con 0x7fcd3c157520 2024-01-27T14:31:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.111+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c0742e0 con 0x7fcd3c157520 2024-01-27T14:31:16.125 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.130+0000 7f5113431040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-27T14:31:16.173 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.178+0000 7f5113431040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-27T14:31:16.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.292+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcd34014bb0 con 0x7fcd3c157520 2024-01-27T14:31:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.292+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcd34026860 con 0x7fcd3c157520 2024-01-27T14:31:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.292+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fcd34018020 con 0x7fcd3c157520 2024-01-27T14:31:16.354 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.358+0000 7f1ecf02c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-27T14:31:16.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.366+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "abfc146b-b77e-4c85-880a-b129f6dd3e0a", "id": 1} v 0) v1 -- 0x7fcd3c0c5cc0 con 0x7fcd3c157520 2024-01-27T14:31:16.495 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.499+0000 7f1ecf02c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-27T14:31:16.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.511+0000 7fcd237fe640 1 -- 172.21.15.73:0/2998991417 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "abfc146b-b77e-4c85-880a-b129f6dd3e0a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd34026c60 con 0x7fcd3c157520 2024-01-27T14:31:16.507 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 msgr2=0x7fcd3c1e1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400efc0 tx=0x7fcd3400c490 comp rx=0 tx=0).stop 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 shutdown_connections 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd3c157520 0x7fcd3c1e1f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd3c1517f0 0x7fcd3c1e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 --2- 172.21.15.73:0/2998991417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd3c06cfd0 0x7fcd3c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 >> 172.21.15.73:0/2998991417 conn(0x7fcd3c0c7a00 msgr2=0x7fcd3c1e2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 shutdown_connections 2024-01-27T14:31:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.512+0000 7fcd41497640 1 -- 172.21.15.73:0/2998991417 wait complete. 2024-01-27T14:31:16.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 2ac7df3f-553a-4e14-bc2c-3e79c650baca 2 2024-01-27T14:31:16.596 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.601+0000 7f5113431040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-27T14:31:16.619 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.623+0000 7f1ecf02c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-27T14:31:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.666+0000 7f77fc366640 1 Processor -- start 2024-01-27T14:31:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.666+0000 7f77fc366640 1 -- start start 2024-01-27T14:31:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77fc366640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77f406dfc0 0x7f77f4161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77fc366640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f4150d50 con 0x7f77f40c8630 2024-01-27T14:31:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77fc366640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f40c0fa0 con 0x7f77f4150970 2024-01-27T14:31:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77fc366640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40c1e80 con 0x7f77f406dfc0 2024-01-27T14:31:16.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77fa903640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77f406dfc0 0x7f77f4161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77f9901640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f77f40c8630 0x7f77f406d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.73:43694/0 (socket says 172.21.15.73:43694) 2024-01-27T14:31:16.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.667+0000 7f77f9901640 1 -- 172.21.15.73:0/3022074859 learned_addr learned my addr 172.21.15.73:0/3022074859 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-01-27T14:31:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.670+0000 7f77fa903640 1 -- 172.21.15.73:0/3022074859 >> v1:172.21.15.73:6789/0 conn(0x7f77f4150970 legacy=0x7f77f40c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.670+0000 7f77fa903640 1 -- 172.21.15.73:0/3022074859 >> v1:172.21.15.46:6789/0 conn(0x7f77f40c8630 legacy=0x7f77f406d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.670+0000 7f77fa903640 1 -- 172.21.15.73:0/3022074859 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40c1200 con 0x7f77f406dfc0 2024-01-27T14:31:16.666 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.670+0000 7f1ecf02c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-27T14:31:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.671+0000 7f77fa903640 1 --2- 172.21.15.73:0/3022074859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f406dfc0 0x7f77f4161e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b263b94c98c90c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.676+0000 7f77f9100640 1 -- 172.21.15.73:0/3022074859 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec02cd00 con 0x7f77f406dfc0 2024-01-27T14:31:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.676+0000 7f77f9100640 1 -- 172.21.15.73:0/3022074859 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec02ce60 con 0x7f77f406dfc0 2024-01-27T14:31:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.676+0000 7f77f9100640 1 -- 172.21.15.73:0/3022074859 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec034660 con 0x7f77f406dfc0 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 -- 172.21.15.73:0/3022074859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f406dfc0 msgr2=0x7f77f4161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 --2- 172.21.15.73:0/3022074859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f406dfc0 0x7f77f4161e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec02bf50 comp rx=0 tx=0).stop 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 -- 172.21.15.73:0/3022074859 shutdown_connections 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 --2- 172.21.15.73:0/3022074859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f406dfc0 0x7f77f4161e30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 -- 172.21.15.73:0/3022074859 >> 172.21.15.73:0/3022074859 conn(0x7f77f40cbf80 msgr2=0x7f77f40cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 -- 172.21.15.73:0/3022074859 shutdown_connections 2024-01-27T14:31:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.677+0000 7f77fc366640 1 -- 172.21.15.73:0/3022074859 wait complete. 2024-01-27T14:31:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.678+0000 7f77fc366640 1 Processor -- start 2024-01-27T14:31:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.678+0000 7f77fc366640 1 -- start start 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 0x7f77f41ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 0x7f77f414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4150970 0x7f77f4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41f2b30 con 0x7f77f406dfc0 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41f2e10 con 0x7f77f4150970 2024-01-27T14:31:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.679+0000 7f77fc366640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41f30f0 con 0x7f77f40c8630 2024-01-27T14:31:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.680+0000 7f77fa102640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 0x7f77f41ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.680+0000 7f77f9901640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 0x7f77f414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.680+0000 7f77fa903640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4150970 0x7f77f4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.680+0000 7f77fa102640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 0x7f77f41ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.73:46014/0 (socket says 172.21.15.73:46014) 2024-01-27T14:31:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.680+0000 7f77fa102640 1 -- 172.21.15.73:0/998452647 learned_addr learned my addr 172.21.15.73:0/998452647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.683+0000 7f77f9901640 1 -- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4150970 msgr2=0x7f77f4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.683+0000 7f77f9901640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4150970 0x7f77f4146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.683+0000 7f77f9901640 1 -- 172.21.15.73:0/998452647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 msgr2=0x7f77f41ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.683+0000 7f77f9901640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 0x7f77f41ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.683+0000 7f77f9901640 1 -- 172.21.15.73:0/998452647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec009a70 con 0x7f77f40c8630 2024-01-27T14:31:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.687+0000 7f77f9901640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 0x7f77f414fb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77e4000f60 tx=0x7f77e400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:16.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.691+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4005ce0 con 0x7f77f40c8630 2024-01-27T14:31:16.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.691+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4005e40 con 0x7f77f40c8630 2024-01-27T14:31:16.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.691+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4007310 con 0x7f77f40c8630 2024-01-27T14:31:16.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.691+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f41f33d0 con 0x7f77f40c8630 2024-01-27T14:31:16.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.691+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f4150060 con 0x7f77f40c8630 2024-01-27T14:31:16.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.692+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f41f38f0 con 0x7f77f40c8630 2024-01-27T14:31:16.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.694+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f77e4007470 con 0x7f77f40c8630 2024-01-27T14:31:16.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.694+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f77e401b7d0 con 0x7f77f40c8630 2024-01-27T14:31:16.740 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:16.745+0000 7f5113431040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-27T14:31:16.767 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.771+0000 7f1ecf02c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-27T14:31:16.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.792+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f77f41f38f0 con 0x7f77f40c8630 2024-01-27T14:31:16.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.864+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ac7df3f-553a-4e14-bc2c-3e79c650baca", "id": 2} v 0) v1 -- 0x7f77f4067960 con 0x7f77f40c8630 2024-01-27T14:31:16.865 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:16.869+0000 7f1ecf02c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-27T14:31:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.935+0000 7f77eaffd640 1 -- 172.21.15.73:0/998452647 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ac7df3f-553a-4e14-bc2c-3e79c650baca", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77e4017070 con 0x7f77f40c8630 2024-01-27T14:31:16.931 INFO:teuthology.orchestra.run.smithi073.stdout:2 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 msgr2=0x7f77f414fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 0x7f77f414fb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77e4000f60 tx=0x7f77e400c760 comp rx=0 tx=0).stop 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 shutdown_connections 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4150970 0x7f77f4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77f40c8630 0x7f77f414fb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 --2- 172.21.15.73:0/998452647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77f406dfc0 0x7f77f41ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 >> 172.21.15.73:0/998452647 conn(0x7f77f40cbf80 msgr2=0x7f77f40c4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 shutdown_connections 2024-01-27T14:31:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:16.936+0000 7f77fc366640 1 -- 172.21.15.73:0/998452647 wait complete. 2024-01-27T14:31:16.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new dd39dbb2-e1ff-4998-aeb1-131545d5af1f 3 2024-01-27T14:31:17.011 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:17.015+0000 7f1ecf02c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-27T14:31:17.054 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:17.058+0000 7f1ecf02c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-27T14:31:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.083+0000 7fb03f7a4640 1 Processor -- start 2024-01-27T14:31:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.083+0000 7fb03f7a4640 1 -- start start 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.084+0000 7fb03f7a4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb038153a20 0x7fb0380ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.084+0000 7fb03f7a4640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.084+0000 7fb03f7a4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03806bed0 con 0x7fb0380cbd80 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.084+0000 7fb03f7a4640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03806cdc0 con 0x7fb038153a20 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.084+0000 7fb03f7a4640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03806c1b0 con 0x7fb03815a3c0 2024-01-27T14:31:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.085+0000 7fb03cd3f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.085+0000 7fb03d540640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb038153a20 0x7fb0380ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.085+0000 7fb03cd3f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:51764/0 (socket says 172.21.15.73:51764) 2024-01-27T14:31:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.085+0000 7fb03cd3f640 1 -- 172.21.15.73:0/2867726647 learned_addr learned my addr 172.21.15.73:0/2867726647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.087+0000 7fb03cd3f640 1 -- 172.21.15.73:0/2867726647 >> v2:172.21.15.46:3300/0 conn(0x7fb038153a20 msgr2=0x7fb0380ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.087+0000 7fb03cd3f640 1 --2- 172.21.15.73:0/2867726647 >> v2:172.21.15.46:3300/0 conn(0x7fb038153a20 0x7fb0380ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.087+0000 7fb03cd3f640 1 -- 172.21.15.73:0/2867726647 >> v1:172.21.15.46:6789/0 conn(0x7fb0380cbd80 legacy=0x7fb0380b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.087+0000 7fb03cd3f640 1 -- 172.21.15.73:0/2867726647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03806c490 con 0x7fb03815a3c0 2024-01-27T14:31:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.089+0000 7fb03cd3f640 1 --2- 172.21.15.73:0/2867726647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed050dbf19827b78 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.091+0000 7fb02ffff640 1 -- 172.21.15.73:0/2867726647 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028030840 con 0x7fb03815a3c0 2024-01-27T14:31:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb02ffff640 1 -- 172.21.15.73:0/2867726647 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280309a0 con 0x7fb03815a3c0 2024-01-27T14:31:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb02ffff640 1 -- 172.21.15.73:0/2867726647 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028030d30 con 0x7fb03815a3c0 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 -- 172.21.15.73:0/2867726647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 msgr2=0x7fb0380ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/2867726647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02802b980 comp rx=0 tx=0).stop 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 -- 172.21.15.73:0/2867726647 shutdown_connections 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/2867726647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb03815a3c0 0x7fb0380ca590 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/2867726647 >> v2:172.21.15.46:3300/0 conn(0x7fb038153a20 0x7fb0380ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 -- 172.21.15.73:0/2867726647 >> 172.21.15.73:0/2867726647 conn(0x7fb038071fd0 msgr2=0x7fb0380723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 -- 172.21.15.73:0/2867726647 shutdown_connections 2024-01-27T14:31:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.093+0000 7fb03f7a4640 1 -- 172.21.15.73:0/2867726647 wait complete. 2024-01-27T14:31:17.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.095+0000 7fb03f7a4640 1 Processor -- start 2024-01-27T14:31:17.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.095+0000 7fb03f7a4640 1 -- start start 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0380cbd80 0x7fb0381582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb03815a3c0 0x7fb0381f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb038158fd0 con 0x7fb03815a3c0 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380cd140 con 0x7fb0380cbd80 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03f7a4640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0381f1ce0 con 0x7fb038153a20 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03dd41640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb03815a3c0 0x7fb0381f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03d540640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0380cbd80 0x7fb0381582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03cd3f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03cd3f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:51766/0 (socket says 172.21.15.73:51766) 2024-01-27T14:31:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.096+0000 7fb03cd3f640 1 -- 172.21.15.73:0/1732807464 learned_addr learned my addr 172.21.15.73:0/1732807464 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.100+0000 7fb03cd3f640 1 -- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0380cbd80 msgr2=0x7fb0381582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.100+0000 7fb03cd3f640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0380cbd80 0x7fb0381582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.100+0000 7fb03cd3f640 1 -- 172.21.15.73:0/1732807464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb03815a3c0 msgr2=0x7fb0381f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.100+0000 7fb03cd3f640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb03815a3c0 0x7fb0381f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.100+0000 7fb03cd3f640 1 -- 172.21.15.73:0/1732807464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280094d0 con 0x7fb038153a20 2024-01-27T14:31:17.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.102+0000 7fb03cd3f640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.105+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028039a90 con 0x7fb038153a20 2024-01-27T14:31:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.105+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028039bf0 con 0x7fb038153a20 2024-01-27T14:31:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.105+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb038153f80 con 0x7fb038153a20 2024-01-27T14:31:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.105+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028043410 con 0x7fb038153a20 2024-01-27T14:31:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.106+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0381f10d0 con 0x7fb038153a20 2024-01-27T14:31:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.106+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0381523d0 con 0x7fb038153a20 2024-01-27T14:31:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.110+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb028043570 con 0x7fb038153a20 2024-01-27T14:31:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.110+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb02804c840 con 0x7fb038153a20 2024-01-27T14:31:17.163 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.168+0000 7f5113431040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-27T14:31:17.201 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:17.205+0000 7f1ecf02c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-27T14:31:17.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.214+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fb028048070 con 0x7fb038153a20 2024-01-27T14:31:17.211 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.216+0000 7f5113431040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-27T14:31:17.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.288+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dd39dbb2-e1ff-4998-aeb1-131545d5af1f", "id": 3} v 0) v1 -- 0x7fb0380c9640 con 0x7fb038153a20 2024-01-27T14:31:17.316 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.318+0000 7f5113431040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-27T14:31:17.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.365+0000 7fb02dffb640 1 -- 172.21.15.73:0/1732807464 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd39dbb2-e1ff-4998-aeb1-131545d5af1f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb028034070 con 0x7fb038153a20 2024-01-27T14:31:17.361 INFO:teuthology.orchestra.run.smithi073.stdout:3 2024-01-27T14:31:17.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 msgr2=0x7fb038158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028004730 comp rx=0 tx=0).stop 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 shutdown_connections 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb03815a3c0 0x7fb0381f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb038153a20 0x7fb038158a90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 --2- 172.21.15.73:0/1732807464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0380cbd80 0x7fb0381582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 >> 172.21.15.73:0/1732807464 conn(0x7fb038071fd0 msgr2=0x7fb038150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 shutdown_connections 2024-01-27T14:31:17.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.367+0000 7fb03f7a4640 1 -- 172.21.15.73:0/1732807464 wait complete. 2024-01-27T14:31:17.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 1cb39a57-de30-4de9-96c2-6e2af62ac9a8 4 2024-01-27T14:31:17.418 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.422+0000 7f5113431040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-27T14:31:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.477+0000 7f96823d5640 1 Processor -- start 2024-01-27T14:31:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.477+0000 7f96823d5640 1 -- start start 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.478+0000 7f96823d5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f967c0ca340 0x7f967c070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.478+0000 7f96823d5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.478+0000 7f96823d5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c15cd50 con 0x7f967c153930 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.478+0000 7f96823d5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c06d3f0 con 0x7f967c0ca340 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.478+0000 7f96823d5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0c9580 con 0x7f967c071270 2024-01-27T14:31:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.479+0000 7f9680972640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.479+0000 7f967b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f967c0ca340 0x7f967c070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.479+0000 7f9680972640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:51776/0 (socket says 172.21.15.73:51776) 2024-01-27T14:31:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.479+0000 7f9680972640 1 -- 172.21.15.73:0/320684797 learned_addr learned my addr 172.21.15.73:0/320684797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.481+0000 7f9680972640 1 -- 172.21.15.73:0/320684797 >> v2:172.21.15.46:3300/0 conn(0x7f967c0ca340 msgr2=0x7f967c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.481+0000 7f9680972640 1 --2- 172.21.15.73:0/320684797 >> v2:172.21.15.46:3300/0 conn(0x7f967c0ca340 0x7f967c070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.481+0000 7f9680972640 1 -- 172.21.15.73:0/320684797 >> v1:172.21.15.46:6789/0 conn(0x7f967c153930 legacy=0x7f967c0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.481+0000 7f9680972640 1 -- 172.21.15.73:0/320684797 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c159a30 con 0x7f967c071270 2024-01-27T14:31:17.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.483+0000 7f9680972640 1 --2- 172.21.15.73:0/320684797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e50 tx=0x7f967402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d2f54fec852ef7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.487+0000 7f967affd640 1 -- 172.21.15.73:0/320684797 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967402cb90 con 0x7f967c071270 2024-01-27T14:31:17.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.487+0000 7f967affd640 1 -- 172.21.15.73:0/320684797 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967402ccf0 con 0x7f967c071270 2024-01-27T14:31:17.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.487+0000 7f967affd640 1 -- 172.21.15.73:0/320684797 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674034610 con 0x7f967c071270 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 -- 172.21.15.73:0/320684797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 msgr2=0x7f967c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 --2- 172.21.15.73:0/320684797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e50 tx=0x7f967402bff0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 -- 172.21.15.73:0/320684797 shutdown_connections 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 --2- 172.21.15.73:0/320684797 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c071270 0x7f967c15d200 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 --2- 172.21.15.73:0/320684797 >> v2:172.21.15.46:3300/0 conn(0x7f967c0ca340 0x7f967c070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 -- 172.21.15.73:0/320684797 >> 172.21.15.73:0/320684797 conn(0x7f967c066c80 msgr2=0x7f967c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 -- 172.21.15.73:0/320684797 shutdown_connections 2024-01-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.488+0000 7f96823d5640 1 -- 172.21.15.73:0/320684797 wait complete. 2024-01-27T14:31:17.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.489+0000 7f96823d5640 1 Processor -- start 2024-01-27T14:31:17.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 -- start start 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c0ca340 0x7f967c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f967c153930 0x7f967c0c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0c4120 con 0x7f967c071270 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c157ae0 con 0x7f967c153930 2024-01-27T14:31:17.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.490+0000 7f96823d5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1efe50 con 0x7f967c0ca340 2024-01-27T14:31:17.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.491+0000 7f967b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c0ca340 0x7f967c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.491+0000 7f967bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.491+0000 7f9680972640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f967c153930 0x7f967c0c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.491+0000 7f967bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.73:46048/0 (socket says 172.21.15.73:46048) 2024-01-27T14:31:17.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.491+0000 7f967bfff640 1 -- 172.21.15.73:0/3715660459 learned_addr learned my addr 172.21.15.73:0/3715660459 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.495+0000 7f967bfff640 1 -- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c0ca340 msgr2=0x7f967c0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.495+0000 7f967bfff640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c0ca340 0x7f967c0c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.495+0000 7f967bfff640 1 -- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f967c153930 msgr2=0x7f967c0c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.495+0000 7f967bfff640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f967c153930 0x7f967c0c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.495+0000 7f967bfff640 1 -- 172.21.15.73:0/3715660459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009b30 con 0x7f967c071270 2024-01-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.497+0000 7f967bfff640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f967000c400 tx=0x7f967000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.500+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96700052d0 con 0x7f967c071270 2024-01-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.500+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670005450 con 0x7f967c071270 2024-01-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.500+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c157d80 con 0x7f967c071270 2024-01-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.500+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670007260 con 0x7f967c071270 2024-01-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.501+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c158340 con 0x7f967c071270 2024-01-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.501+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c0742e0 con 0x7f967c071270 2024-01-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.504+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f96700073c0 con 0x7f967c071270 2024-01-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.504+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9670011590 con 0x7f967c071270 2024-01-27T14:31:17.564 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.568+0000 7f5113431040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-27T14:31:17.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.609+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f9670020060 con 0x7f967c071270 2024-01-27T14:31:17.605 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.610+0000 7f5113431040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-27T14:31:17.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.686+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1cb39a57-de30-4de9-96c2-6e2af62ac9a8", "id": 4} v 0) v1 -- 0x7f967c14f110 con 0x7f967c071270 2024-01-27T14:31:17.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.716+0000 7f9678ff9640 1 -- 172.21.15.73:0/3715660459 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1cb39a57-de30-4de9-96c2-6e2af62ac9a8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9670003950 con 0x7f967c071270 2024-01-27T14:31:17.712 INFO:teuthology.orchestra.run.smithi073.stdout:4 2024-01-27T14:31:17.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 msgr2=0x7f967c14e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f967000c400 tx=0x7f967000c8c0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 shutdown_connections 2024-01-27T14:31:17.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f967c153930 0x7f967c0c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f967c0ca340 0x7f967c0c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 --2- 172.21.15.73:0/3715660459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f967c071270 0x7f967c14e220 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 >> 172.21.15.73:0/3715660459 conn(0x7f967c066c80 msgr2=0x7f967c1517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:17.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 shutdown_connections 2024-01-27T14:31:17.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.717+0000 7f96823d5640 1 -- 172.21.15.73:0/3715660459 wait complete. 2024-01-27T14:31:17.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new dba0b812-1b4e-4892-9f39-4fd1ff589c4c 5 2024-01-27T14:31:17.761 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:17.766+0000 7f5113431040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-27T14:31:17.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.829+0000 7f0cdef25640 1 Processor -- start 2024-01-27T14:31:17.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.829+0000 7f0cdef25640 1 -- start start 2024-01-27T14:31:17.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.830+0000 7f0cdef25640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd8161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.830+0000 7f0cdef25640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd8150d50 con 0x7f0cd8150970 2024-01-27T14:31:17.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.830+0000 7f0cdef25640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd80c0fa0 con 0x7f0cd80c8630 2024-01-27T14:31:17.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.830+0000 7f0cdef25640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80c1e80 con 0x7f0cd806dfc0 2024-01-27T14:31:17.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.831+0000 7f0cdd4c2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd8161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.831+0000 7f0cd7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0cd80c8630 0x7f0cd806d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56506/0 (socket says 172.21.15.73:56506) 2024-01-27T14:31:17.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.831+0000 7f0cd7fff640 1 -- 172.21.15.73:0/1605538433 learned_addr learned my addr 172.21.15.73:0/1605538433 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-01-27T14:31:17.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.833+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284630008 0 0) 0x7f0ccc001110 con 0x7f0cd8150970 2024-01-27T14:31:17.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.833+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc8003520 con 0x7f0cd8150970 2024-01-27T14:31:17.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.834+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839412624 0 0) 0x7f0cd80c0fa0 con 0x7f0cd80c8630 2024-01-27T14:31:17.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.834+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc001110 con 0x7f0cd80c8630 2024-01-27T14:31:17.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.834+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/1605538433 >> v1:172.21.15.73:6789/0 conn(0x7f0cd80c8630 legacy=0x7f0cd806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.834+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/1605538433 >> v1:172.21.15.46:6789/0 conn(0x7f0cd8150970 legacy=0x7f0cd80c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.834+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/1605538433 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80c1200 con 0x7f0cd806dfc0 2024-01-27T14:31:17.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.835+0000 7f0cdd4c2640 1 --2- 172.21.15.73:0/1605538433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd8161e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009dc0 tx=0x7f0cd002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6f3483b804cb043 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.838+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd002cd50 con 0x7f0cd806dfc0 2024-01-27T14:31:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.840+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0034440 con 0x7f0cd806dfc0 2024-01-27T14:31:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.840+0000 7f0cd77fe640 1 -- 172.21.15.73:0/1605538433 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00347b0 con 0x7f0cd806dfc0 2024-01-27T14:31:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 -- 172.21.15.73:0/1605538433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 msgr2=0x7f0cd8161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 --2- 172.21.15.73:0/1605538433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd8161e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009dc0 tx=0x7f0cd002bfa0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 -- 172.21.15.73:0/1605538433 shutdown_connections 2024-01-27T14:31:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 --2- 172.21.15.73:0/1605538433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd8161e30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 -- 172.21.15.73:0/1605538433 >> 172.21.15.73:0/1605538433 conn(0x7f0cd80cbf80 msgr2=0x7f0cd80cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 -- 172.21.15.73:0/1605538433 shutdown_connections 2024-01-27T14:31:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.841+0000 7f0cdef25640 1 -- 172.21.15.73:0/1605538433 wait complete. 2024-01-27T14:31:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.842+0000 7f0cdef25640 1 Processor -- start 2024-01-27T14:31:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.842+0000 7f0cdef25640 1 -- start start 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 0x7f0cd81e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81e1db0 con 0x7f0cd80c8630 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81f2430 con 0x7f0cd8150970 2024-01-27T14:31:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.843+0000 7f0cdef25640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81f2cd0 con 0x7f0cd806dfc0 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cdccc1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cdd4c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 0x7f0cd81e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.73:46050/0 (socket says 172.21.15.73:46050) 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cd7fff640 1 -- 172.21.15.73:0/446394094 learned_addr learned my addr 172.21.15.73:0/446394094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.844+0000 7f0cdccc1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd814e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:51798/0 (socket says 172.21.15.73:51798) 2024-01-27T14:31:17.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.847+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 msgr2=0x7f0cd814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.847+0000 7f0cdd4c2640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd814e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.847+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/446394094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 msgr2=0x7f0cd81543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.847+0000 7f0cdd4c2640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.847+0000 7f0cdd4c2640 1 -- 172.21.15.73:0/446394094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009a70 con 0x7f0cd8150970 2024-01-27T14:31:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.848+0000 7f0cd7fff640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:31:17.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.850+0000 7f0cdd4c2640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 0x7f0cd81e0a10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0033000 tx=0x7f0cd0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.853+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0004450 con 0x7f0cd8150970 2024-01-27T14:31:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.853+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00045b0 con 0x7f0cd8150970 2024-01-27T14:31:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.853+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd81e2000 con 0x7f0cd8150970 2024-01-27T14:31:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.853+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0009450 con 0x7f0cd8150970 2024-01-27T14:31:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.853+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd81f2680 con 0x7f0cd8150970 2024-01-27T14:31:17.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.854+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd80742e0 con 0x7f0cd8150970 2024-01-27T14:31:17.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.856+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0cd0034940 con 0x7f0cd8150970 2024-01-27T14:31:17.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.856+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0cd0040d30 con 0x7f0cd8150970 2024-01-27T14:31:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:17.953+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0cd0044020 con 0x7f0cd8150970 2024-01-27T14:31:18.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.025+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dba0b812-1b4e-4892-9f39-4fd1ff589c4c", "id": 5} v 0) v1 -- 0x7f0cd81f2e10 con 0x7f0cd8150970 2024-01-27T14:31:18.030 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:18.034+0000 7f1ecf02c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-27T14:31:18.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.090+0000 7f0cd57fa640 1 -- 172.21.15.73:0/446394094 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dba0b812-1b4e-4892-9f39-4fd1ff589c4c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0cd0039070 con 0x7f0cd8150970 2024-01-27T14:31:18.086 INFO:teuthology.orchestra.run.smithi073.stdout:5 2024-01-27T14:31:18.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.090+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 msgr2=0x7f0cd81e0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.090+0000 7f0cdef25640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 0x7f0cd81e0a10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0033000 tx=0x7f0cd0004a40 comp rx=0 tx=0).stop 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 shutdown_connections 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd8150970 0x7f0cd81e0a10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cd80c8630 0x7f0cd81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 --2- 172.21.15.73:0/446394094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0cd806dfc0 0x7f0cd814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 >> 172.21.15.73:0/446394094 conn(0x7f0cd80cbf80 msgr2=0x7f0cd80c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 shutdown_connections 2024-01-27T14:31:18.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.091+0000 7f0cdef25640 1 -- 172.21.15.73:0/446394094 wait complete. 2024-01-27T14:31:18.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 822d4e46-972c-4034-9089-8ae0417aac49 6 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.246+0000 7fd546223640 1 Processor -- start 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.246+0000 7fd546223640 1 -- start start 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.247+0000 7fd546223640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.247+0000 7fd546223640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd54006dfc0 0x7fd5400c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.247+0000 7fd546223640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd540150d50 con 0x7fd5400c8630 2024-01-27T14:31:18.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.247+0000 7fd546223640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5400c1e80 con 0x7fd54006dfc0 2024-01-27T14:31:18.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.247+0000 7fd546223640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400c0fa0 con 0x7fd540150970 2024-01-27T14:31:18.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.248+0000 7fd53ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd54006dfc0 0x7fd5400c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.248+0000 7fd53f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.248+0000 7fd53f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:51808/0 (socket says 172.21.15.73:51808) 2024-01-27T14:31:18.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.248+0000 7fd53f7fe640 1 -- 172.21.15.73:0/4000140248 learned_addr learned my addr 172.21.15.73:0/4000140248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.251+0000 7fd53ffff640 1 -- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 msgr2=0x7fd5400c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.251+0000 7fd53ffff640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.251+0000 7fd53ffff640 1 -- 172.21.15.73:0/4000140248 >> v1:172.21.15.73:6789/0 conn(0x7fd5400c8630 legacy=0x7fd54006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.251+0000 7fd53ffff640 1 -- 172.21.15.73:0/4000140248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5400c1200 con 0x7fd54006dfc0 2024-01-27T14:31:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.251+0000 7fd53f7fe640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:31:18.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.254+0000 7fd53ffff640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd54006dfc0 0x7fd5400c7580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd538009d90 tx=0x7fd53802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268ee56a44b4397d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:18.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.258+0000 7fd53e7fc640 1 -- 172.21.15.73:0/4000140248 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53802cc50 con 0x7fd54006dfc0 2024-01-27T14:31:18.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.258+0000 7fd53e7fc640 1 -- 172.21.15.73:0/4000140248 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53802cdb0 con 0x7fd54006dfc0 2024-01-27T14:31:18.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.258+0000 7fd53e7fc640 1 -- 172.21.15.73:0/4000140248 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538034660 con 0x7fd54006dfc0 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 -- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd54006dfc0 msgr2=0x7fd5400c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd54006dfc0 0x7fd5400c7580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd538009d90 tx=0x7fd53802bea0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 -- 172.21.15.73:0/4000140248 shutdown_connections 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd54006dfc0 0x7fd5400c7580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 --2- 172.21.15.73:0/4000140248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd5400c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 -- 172.21.15.73:0/4000140248 >> 172.21.15.73:0/4000140248 conn(0x7fd5400cbf80 msgr2=0x7fd5400cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 -- 172.21.15.73:0/4000140248 shutdown_connections 2024-01-27T14:31:18.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.259+0000 7fd546223640 1 -- 172.21.15.73:0/4000140248 wait complete. 2024-01-27T14:31:18.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.260+0000 7fd546223640 1 Processor -- start 2024-01-27T14:31:18.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.260+0000 7fd546223640 1 -- start start 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd54006dfc0 0x7fd5401ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd540155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401f0ba0 con 0x7fd54006dfc0 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540146c90 con 0x7fd5400c8630 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd546223640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401f13e0 con 0x7fd540150970 2024-01-27T14:31:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.261+0000 7fd53effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.262+0000 7fd53f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd54006dfc0 0x7fd5401ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.262+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd540155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.262+0000 7fd53effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46508/0 (socket says 172.21.15.73:46508) 2024-01-27T14:31:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.262+0000 7fd53effd640 1 -- 172.21.15.73:0/4016905845 learned_addr learned my addr 172.21.15.73:0/4016905845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.265+0000 7fd53effd640 1 -- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 msgr2=0x7fd540155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.265+0000 7fd53effd640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd540155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.265+0000 7fd53effd640 1 -- 172.21.15.73:0/4016905845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd54006dfc0 msgr2=0x7fd5401ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.265+0000 7fd53effd640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd54006dfc0 0x7fd5401ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.265+0000 7fd53effd640 1 -- 172.21.15.73:0/4016905845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340094d0 con 0x7fd5400c8630 2024-01-27T14:31:18.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.267+0000 7fd53effd640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd53000b3c0 tx=0x7fd53000b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:18.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.270+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530011830 con 0x7fd5400c8630 2024-01-27T14:31:18.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.270+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530011990 con 0x7fd5400c8630 2024-01-27T14:31:18.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.270+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530011d20 con 0x7fd5400c8630 2024-01-27T14:31:18.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.270+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538009a70 con 0x7fd5400c8630 2024-01-27T14:31:18.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.271+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5401479f0 con 0x7fd5400c8630 2024-01-27T14:31:18.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.271+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5401f1590 con 0x7fd5400c8630 2024-01-27T14:31:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.273+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd53001b460 con 0x7fd5400c8630 2024-01-27T14:31:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.273+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd530024dc0 con 0x7fd5400c8630 2024-01-27T14:31:18.316 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:18.320+0000 7f1ecf02c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-27T14:31:18.369 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:18.373+0000 7f1ecf02c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-27T14:31:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.374+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fd5401f1590 con 0x7fd5400c8630 2024-01-27T14:31:18.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.447+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "822d4e46-972c-4034-9089-8ae0417aac49", "id": 6} v 0) v1 -- 0x7fd540157250 con 0x7fd5400c8630 2024-01-27T14:31:18.473 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:18.477+0000 7f1ecf02c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-27T14:31:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.535+0000 7fd527fff640 1 -- 172.21.15.73:0/4016905845 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "822d4e46-972c-4034-9089-8ae0417aac49", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd530024740 con 0x7fd5400c8630 2024-01-27T14:31:18.531 INFO:teuthology.orchestra.run.smithi073.stdout:6 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 msgr2=0x7fd54014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd53000b3c0 tx=0x7fd53000b880 comp rx=0 tx=0).stop 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 shutdown_connections 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5400c8630 0x7fd54014cdb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd540150970 0x7fd540155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 --2- 172.21.15.73:0/4016905845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd54006dfc0 0x7fd5401ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 >> 172.21.15.73:0/4016905845 conn(0x7fd5400cbf80 msgr2=0x7fd54006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 shutdown_connections 2024-01-27T14:31:18.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.536+0000 7fd546223640 1 -- 172.21.15.73:0/4016905845 wait complete. 2024-01-27T14:31:18.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 0fe330fa-b80a-4aa9-99a9-cbbee492ec74 7 2024-01-27T14:31:18.628 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:18.632+0000 7f5113431040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-27T14:31:18.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.646+0000 7f8c876d3640 1 Processor -- start 2024-01-27T14:31:18.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.646+0000 7f8c876d3640 1 -- start start 2024-01-27T14:31:18.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.647+0000 7f8c876d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c80150970 0x7f8c800c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c876d3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c80150d50 con 0x7f8c800c8630 2024-01-27T14:31:18.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c876d3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c800c0fa0 con 0x7f8c8006dfc0 2024-01-27T14:31:18.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c876d3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c800c1e80 con 0x7f8c80150970 2024-01-27T14:31:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c8546f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c80150970 0x7f8c800c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c8546f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c80150970 0x7f8c800c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46518/0 (socket says 172.21.15.73:46518) 2024-01-27T14:31:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.648+0000 7f8c8546f640 1 -- 172.21.15.73:0/2624134420 learned_addr learned my addr 172.21.15.73:0/2624134420 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:18.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.651+0000 7f8c8546f640 1 -- 172.21.15.73:0/2624134420 >> v1:172.21.15.73:6789/0 conn(0x7f8c8006dfc0 legacy=0x7f8c80160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:18.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.651+0000 7f8c8546f640 1 -- 172.21.15.73:0/2624134420 >> v1:172.21.15.46:6789/0 conn(0x7f8c800c8630 legacy=0x7f8c8006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:18.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.651+0000 7f8c8546f640 1 -- 172.21.15.73:0/2624134420 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800c1200 con 0x7f8c80150970 2024-01-27T14:31:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.653+0000 7f8c8546f640 1 --2- 172.21.15.73:0/2624134420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c80150970 0x7f8c800c7040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009870 tx=0x7f8c7802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb6be0f0614fb6a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.657+0000 7f8c77fff640 1 -- 172.21.15.73:0/2624134420 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78030860 con 0x7f8c80150970 2024-01-27T14:31:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.657+0000 7f8c77fff640 1 -- 172.21.15.73:0/2624134420 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780309c0 con 0x7f8c80150970 2024-01-27T14:31:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.657+0000 7f8c77fff640 1 -- 172.21.15.73:0/2624134420 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78030d50 con 0x7f8c80150970 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 -- 172.21.15.73:0/2624134420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c80150970 msgr2=0x7f8c800c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 --2- 172.21.15.73:0/2624134420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c80150970 0x7f8c800c7040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009870 tx=0x7f8c7802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 -- 172.21.15.73:0/2624134420 shutdown_connections 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 --2- 172.21.15.73:0/2624134420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c80150970 0x7f8c800c7040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 -- 172.21.15.73:0/2624134420 >> 172.21.15.73:0/2624134420 conn(0x7f8c800cbf80 msgr2=0x7f8c800cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 -- 172.21.15.73:0/2624134420 shutdown_connections 2024-01-27T14:31:18.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.658+0000 7f8c876d3640 1 -- 172.21.15.73:0/2624134420 wait complete. 2024-01-27T14:31:18.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.660+0000 7f8c876d3640 1 Processor -- start 2024-01-27T14:31:18.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.660+0000 7f8c876d3640 1 -- start start 2024-01-27T14:31:18.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c800c8630 0x7f8c801f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c80150970 0x7f8c8006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801ed7c0 con 0x7f8c80150970 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801ecd40 con 0x7f8c8006dfc0 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.661+0000 7f8c876d3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801efd20 con 0x7f8c800c8630 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.662+0000 7f8c8546f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.662+0000 7f8c84c6e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c800c8630 0x7f8c801f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.662+0000 7f8c8546f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46532/0 (socket says 172.21.15.73:46532) 2024-01-27T14:31:18.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.662+0000 7f8c8546f640 1 -- 172.21.15.73:0/1803698965 learned_addr learned my addr 172.21.15.73:0/1803698965 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-01-27T14:31:18.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.665+0000 7f8c8546f640 1 -- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c800c8630 msgr2=0x7f8c801f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.665+0000 7f8c8546f640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c800c8630 0x7f8c801f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.665+0000 7f8c8546f640 1 -- 172.21.15.73:0/1803698965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c80150970 msgr2=0x7f8c8006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:18.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.665+0000 7f8c8546f640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c80150970 0x7f8c8006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:18.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.665+0000 7f8c8546f640 1 -- 172.21.15.73:0/1803698965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780094d0 con 0x7f8c8006dfc0 2024-01-27T14:31:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.668+0000 7f8c8546f640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009990 tx=0x7f8c78004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.672+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78039e20 con 0x7f8c8006dfc0 2024-01-27T14:31:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.672+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78043400 con 0x7f8c8006dfc0 2024-01-27T14:31:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.672+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800cb710 con 0x7f8c8006dfc0 2024-01-27T14:31:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.672+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780437b0 con 0x7f8c8006dfc0 2024-01-27T14:31:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.672+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c801f0280 con 0x7f8c8006dfc0 2024-01-27T14:31:18.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.673+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c800742e0 con 0x7f8c8006dfc0 2024-01-27T14:31:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.782+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8c78043910 con 0x7f8c8006dfc0 2024-01-27T14:31:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.782+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8c7803e070 con 0x7f8c8006dfc0 2024-01-27T14:31:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.783+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f8c78034070 con 0x7f8c8006dfc0 2024-01-27T14:31:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.855+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fe330fa-b80a-4aa9-99a9-cbbee492ec74", "id": 7} v 0) v1 -- 0x7f8c80067e60 con 0x7f8c8006dfc0 2024-01-27T14:31:18.935 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:18.939+0000 7f5113431040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-27T14:31:18.988 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:18.992+0000 7f5113431040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-27T14:31:18.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:18.999+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 2) v1 ==== 44628+0+0 (secure 0 0 0) 0x7f8c7804dc20 con 0x7f8c8006dfc0 2024-01-27T14:31:19.090 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-01-27T14:31:19.094+0000 7f5113431040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-27T14:31:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.491+0000 7f8c75ffb640 1 -- 172.21.15.73:0/1803698965 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fe330fa-b80a-4aa9-99a9-cbbee492ec74", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c78042720 con 0x7f8c8006dfc0 2024-01-27T14:31:19.487 INFO:teuthology.orchestra.run.smithi073.stdout:7 2024-01-27T14:31:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 msgr2=0x7f8c801ec800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009990 tx=0x7f8c78004730 comp rx=0 tx=0).stop 2024-01-27T14:31:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 shutdown_connections 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c80150970 0x7f8c8006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c800c8630 0x7f8c801f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 --2- 172.21.15.73:0/1803698965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8006dfc0 0x7f8c801ec800 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 >> 172.21.15.73:0/1803698965 conn(0x7f8c800cbf80 msgr2=0x7f8c800c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 shutdown_connections 2024-01-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-01-27T14:31:19.492+0000 7f8c876d3640 1 -- 172.21.15.73:0/1803698965 wait complete. 2024-01-27T14:31:19.498 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-27T14:31:19.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-27T14:31:19.501 INFO:tasks.ceph.osd.0:Started 2024-01-27T14:31:19.501 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-27T14:31:19.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-27T14:31:19.505 INFO:tasks.ceph.osd.1:Started 2024-01-27T14:31:19.505 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-27T14:31:19.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-27T14:31:19.507 INFO:tasks.ceph.osd.2:Started 2024-01-27T14:31:19.507 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-27T14:31:19.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-27T14:31:19.509 INFO:tasks.ceph.osd.3:Started 2024-01-27T14:31:19.510 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-27T14:31:19.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-27T14:31:19.512 INFO:tasks.ceph.osd.4:Started 2024-01-27T14:31:19.512 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-27T14:31:19.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-27T14:31:19.514 INFO:tasks.ceph.osd.5:Started 2024-01-27T14:31:19.514 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-27T14:31:19.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-27T14:31:19.516 INFO:tasks.ceph.osd.6:Started 2024-01-27T14:31:19.516 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-27T14:31:19.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-27T14:31:19.518 INFO:tasks.ceph.osd.7:Started 2024-01-27T14:31:19.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.644+0000 7f23a253e640 1 Processor -- start 2024-01-27T14:31:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.644+0000 7f23a253e640 1 -- start start 2024-01-27T14:31:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.645+0000 7f23a253e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f239c0c0ec0 0x7f239c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.645+0000 7f23a253e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0c6e20 con 0x7f239c06ef40 2024-01-27T14:31:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.645+0000 7f23a253e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0c68a0 con 0x7f239c14d360 2024-01-27T14:31:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.645+0000 7f23a253e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c15a2f0 con 0x7f239c0c0ec0 2024-01-27T14:31:19.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.663+0000 7f239b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f239c06ef40 0x7f239c1563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41372/0 (socket says 172.21.15.46:41372) 2024-01-27T14:31:19.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.663+0000 7f239b7fe640 1 -- 172.21.15.46:0/3490254568 learned_addr learned my addr 172.21.15.46:0/3490254568 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:19.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.671+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092621352 0 0) 0x7f239c0c6e20 con 0x7f239c06ef40 2024-01-27T14:31:19.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.671+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2388003520 con 0x7f239c06ef40 2024-01-27T14:31:19.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.674+0000 7f23a0adb640 1 --2- 172.21.15.46:0/3490254568 >> v2:172.21.15.73:3300/0 conn(0x7f239c0c0ec0 0x7f239c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413604742 0 0) 0x7f2388003520 con 0x7f239c06ef40 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 >> v2:172.21.15.73:3300/0 conn(0x7f239c0c0ec0 msgr2=0x7f239c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 --2- 172.21.15.46:0/3490254568 >> v2:172.21.15.73:3300/0 conn(0x7f239c0c0ec0 0x7f239c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 >> v1:172.21.15.73:6789/0 conn(0x7f239c14d360 legacy=0x7f239c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c15a4e0 con 0x7f239c06ef40 2024-01-27T14:31:19.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.678+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f2384001670 con 0x7f239c06ef40 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 >> v1:172.21.15.46:6789/0 conn(0x7f239c06ef40 legacy=0x7f239c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23880039c0 0x7f2388003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 0x7f23880047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004fe0 0x7f238800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388010500 con 0x7f2388004fe0 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388010670 con 0x7f23880039c0 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.679+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2388010830 con 0x7f2388004320 2024-01-27T14:31:19.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.680+0000 7f239b7fe640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 0x7f23880047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f239b7fe640 1 -- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23880039c0 msgr2=0x7f2388003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f239b7fe640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23880039c0 0x7f2388003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f239b7fe640 1 -- 172.21.15.46:0/3490254568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004fe0 msgr2=0x7f238800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:19.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f239b7fe640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004fe0 0x7f238800ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f239b7fe640 1 -- 172.21.15.46:0/3490254568 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388003520 con 0x7f2388004320 2024-01-27T14:31:19.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.682+0000 7f23a0adb640 1 -- 172.21.15.46:0/3490254568 reap_dead start 2024-01-27T14:31:19.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.684+0000 7f239b7fe640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 0x7f23880047e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2384007fc0 tx=0x7f23880057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f23495756bb21f0b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:19.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.688+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384005ad0 con 0x7f2388004320 2024-01-27T14:31:19.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.688+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384005c30 con 0x7f2388004320 2024-01-27T14:31:19.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.688+0000 7f239affd640 1 -- 172.21.15.46:0/3490254568 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238402c850 con 0x7f2388004320 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 -- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 msgr2=0x7f23880047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 0x7f23880047e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2384007fc0 tx=0x7f23880057f0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 -- 172.21.15.46:0/3490254568 shutdown_connections 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 --2- 172.21.15.46:0/3490254568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2388004320 0x7f23880047e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 -- 172.21.15.46:0/3490254568 >> 172.21.15.46:0/3490254568 conn(0x7f239c072750 msgr2=0x7f239c06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 -- 172.21.15.46:0/3490254568 shutdown_connections 2024-01-27T14:31:19.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.689+0000 7f23a253e640 1 -- 172.21.15.46:0/3490254568 wait complete. 2024-01-27T14:31:19.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.691+0000 7f23a253e640 1 Processor -- start 2024-01-27T14:31:19.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.691+0000 7f23a253e640 1 -- start start 2024-01-27T14:31:19.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004320 0x7f239c1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f239c1eb440 0x7f239c1eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0c5bb0 con 0x7f2388004320 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c144be0 con 0x7f239c158900 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.692+0000 7f23a253e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0c5720 con 0x7f239c1eb440 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.693+0000 7f239b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.693+0000 7f23a0adb640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f239c1eb440 0x7f239c1eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:19.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.693+0000 7f239b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48690/0 (socket says 172.21.15.46:48690) 2024-01-27T14:31:19.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.693+0000 7f239b7fe640 1 -- 172.21.15.46:0/988406011 learned_addr learned my addr 172.21.15.46:0/988406011 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.696+0000 7f239b7fe640 1 -- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f239c1eb440 msgr2=0x7f239c1eb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.696+0000 7f239b7fe640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f239c1eb440 0x7f239c1eb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.696+0000 7f239b7fe640 1 -- 172.21.15.46:0/988406011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004320 msgr2=0x7f239c1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.696+0000 7f239b7fe640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004320 0x7f239c1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.696+0000 7f239b7fe640 1 -- 172.21.15.46:0/988406011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0c5140 con 0x7f239c158900 2024-01-27T14:31:19.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.698+0000 7f239b7fe640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f238402c4c0 tx=0x7f239c0c6a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.702+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238403c070 con 0x7f239c158900 2024-01-27T14:31:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.702+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238402ca60 con 0x7f239c158900 2024-01-27T14:31:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.702+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238402cdf0 con 0x7f239c158900 2024-01-27T14:31:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.702+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c0c3400 con 0x7f239c158900 2024-01-27T14:31:19.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.702+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c0c39c0 con 0x7f239c158900 2024-01-27T14:31:19.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.703+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c066f20 con 0x7f239c158900 2024-01-27T14:31:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.712+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 2) v1 ==== 44628+0+0 (secure 0 0 0) 0x7f2384032070 con 0x7f239c158900 2024-01-27T14:31:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.713+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2384007be0 con 0x7f239c158900 2024-01-27T14:31:19.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.839+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f2384048770 con 0x7f239c158900 2024-01-27T14:31:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:19.900+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f239c06f3e0 con 0x7f239c158900 2024-01-27T14:31:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.005+0000 7f2398ff9640 1 -- 172.21.15.46:0/988406011 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f2384045030 con 0x7f239c158900 2024-01-27T14:31:20.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:20.002 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:19.133133+0000","last_up_change":"0.000000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 msgr2=0x7f239c145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f238402c4c0 tx=0x7f239c0c6a30 comp rx=0 tx=0).stop 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 shutdown_connections 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f239c158900 0x7f239c145020 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f239c1eb440 0x7f239c1eb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 --2- 172.21.15.46:0/988406011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388004320 0x7f239c1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 >> 172.21.15.46:0/988406011 conn(0x7f239c072750 msgr2=0x7f239c14c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 shutdown_connections 2024-01-27T14:31:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:20.006+0000 7f23a253e640 1 -- 172.21.15.46:0/988406011 wait complete. 2024-01-27T14:31:20.013 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-27T14:31:20.013 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-27T14:31:20.132 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T14:31:20.136+0000 7fc49398f640 -1 Falling back to public interface 2024-01-27T14:31:20.135 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T14:31:20.140+0000 7efc2ed9e640 -1 Falling back to public interface 2024-01-27T14:31:20.184 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:20.187+0000 7fa939df6640 -1 Falling back to public interface 2024-01-27T14:31:20.184 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:31:20.187+0000 7f72012d9640 -1 Falling back to public interface 2024-01-27T14:31:20.184 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:31:20.188+0000 7fa556ac8640 -1 Falling back to public interface 2024-01-27T14:31:20.185 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:20.188+0000 7fa938d9f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2024-01-27T14:31:20.185 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:31:20.188+0000 7fa555a71640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2024-01-27T14:31:20.185 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:20.189+0000 7fa938d9f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2024-01-27T14:31:20.185 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T14:31:20.188+0000 7fd01298c640 -1 Falling back to public interface 2024-01-27T14:31:20.188 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:31:20.192+0000 7fcac64b5640 -1 Falling back to public interface 2024-01-27T14:31:20.194 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T14:31:20.198+0000 7ff9ce99e640 -1 Falling back to public interface 2024-01-27T14:31:20.763 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:20.767+0000 7f1e6fc9c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-27T14:31:20.804 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:31:20.806+0000 7f1e6fc9c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-27T14:31:20.820 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:20.910 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.914+0000 7f62e6608640 1 Processor -- start 2024-01-27T14:31:20.910 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.914+0000 7f62e6608640 1 -- start start 2024-01-27T14:31:20.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62e6608640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62e01582d0 0x7f62e015b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:20.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62e6608640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e015ba70 con 0x7f62e0070ef0 2024-01-27T14:31:20.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62e6608640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00cc720 con 0x7f62e00712d0 2024-01-27T14:31:20.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62e6608640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e0157eb0 con 0x7f62e01582d0 2024-01-27T14:31:20.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62dffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f62e0070ef0 0x7f62e00cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41386/0 (socket says 172.21.15.46:41386) 2024-01-27T14:31:20.912 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62dffff640 1 -- 172.21.15.46:0/773575546 learned_addr learned my addr 172.21.15.46:0/773575546 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:20.912 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.915+0000 7f62df7fe640 1 --2- 172.21.15.46:0/773575546 >> v2:172.21.15.73:3300/0 conn(0x7f62e01582d0 0x7f62e015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:20.914 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.918+0000 7f62deffd640 1 -- 172.21.15.46:0/773575546 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210533306 0 0) 0x7f62d4001110 con 0x7f62e0070ef0 2024-01-27T14:31:20.914 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.918+0000 7f62deffd640 1 -- 172.21.15.46:0/773575546 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c8003520 con 0x7f62e0070ef0 2024-01-27T14:31:20.914 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.918+0000 7f62df7fe640 1 -- 172.21.15.46:0/773575546 >> v1:172.21.15.73:6789/0 conn(0x7f62e00712d0 legacy=0x7f62e00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:20.914 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.918+0000 7f62df7fe640 1 -- 172.21.15.46:0/773575546 >> v1:172.21.15.46:6789/0 conn(0x7f62e0070ef0 legacy=0x7f62e00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:20.914 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.918+0000 7f62df7fe640 1 -- 172.21.15.46:0/773575546 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0157530 con 0x7f62e01582d0 2024-01-27T14:31:20.918 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.923+0000 7f62df7fe640 1 --2- 172.21.15.46:0/773575546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e015b530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009800 tx=0x7f62d002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14cb41ab055bd369 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:20.922 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.926+0000 7f62deffd640 1 -- 172.21.15.46:0/773575546 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0031800 con 0x7f62e01582d0 2024-01-27T14:31:20.922 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.926+0000 7f62deffd640 1 -- 172.21.15.46:0/773575546 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0031960 con 0x7f62e01582d0 2024-01-27T14:31:20.922 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.926+0000 7f62deffd640 1 -- 172.21.15.46:0/773575546 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0031cf0 con 0x7f62e01582d0 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 -- 172.21.15.46:0/773575546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 msgr2=0x7f62e015b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 --2- 172.21.15.46:0/773575546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e015b530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009800 tx=0x7f62d002b8a0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 -- 172.21.15.46:0/773575546 shutdown_connections 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 --2- 172.21.15.46:0/773575546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e015b530 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 -- 172.21.15.46:0/773575546 >> 172.21.15.46:0/773575546 conn(0x7f62e006ad70 msgr2=0x7f62e006f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 -- 172.21.15.46:0/773575546 shutdown_connections 2024-01-27T14:31:20.923 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.927+0000 7f62e6608640 1 -- 172.21.15.46:0/773575546 wait complete. 2024-01-27T14:31:20.924 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.928+0000 7f62e6608640 1 Processor -- start 2024-01-27T14:31:20.924 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.928+0000 7f62e6608640 1 -- start start 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e0070ef0 0x7f62e014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e014e4e0 con 0x7f62e00712d0 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01ede30 con 0x7f62e01582d0 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62e6608640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c6ad0 con 0x7f62e0070ef0 2024-01-27T14:31:20.925 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62df7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:20.926 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.929+0000 7f62dffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e0070ef0 0x7f62e014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:20.926 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.930+0000 7f62e4ba5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:20.926 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.930+0000 7f62df7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47456/0 (socket says 172.21.15.46:47456) 2024-01-27T14:31:20.926 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.930+0000 7f62df7fe640 1 -- 172.21.15.46:0/2504649055 learned_addr learned my addr 172.21.15.46:0/2504649055 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:20.929 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.933+0000 7f62df7fe640 1 -- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e0070ef0 msgr2=0x7f62e014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:20.929 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.933+0000 7f62df7fe640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e0070ef0 0x7f62e014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.929 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.933+0000 7f62df7fe640 1 -- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 msgr2=0x7f62e0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:20.929 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.933+0000 7f62df7fe640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:20.929 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.933+0000 7f62df7fe640 1 -- 172.21.15.46:0/2504649055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0009400 con 0x7f62e00712d0 2024-01-27T14:31:20.931 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.935+0000 7f62df7fe640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62d002b8e0 tx=0x7f62d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.939+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d003aca0 con 0x7f62e00712d0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.939+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d003ae20 con 0x7f62e00712d0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.939+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00c46f0 con 0x7f62e00712d0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.939+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0044630 con 0x7f62e00712d0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.939+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e00c6510 con 0x7f62e00712d0 2024-01-27T14:31:20.935 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:20.940+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00c4880 con 0x7f62e00712d0 2024-01-27T14:31:21.198 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.202+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 3) v1 ==== 89044+0+0 (secure 0 0 0) 0x7f62d004d450 con 0x7f62e00712d0 2024-01-27T14:31:21.198 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.202+0000 7f62dcff9640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 0x7f62cc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:21.198 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.202+0000 7f62dffff640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 0x7f62cc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:21.198 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.202+0000 7f62dffff640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 0x7f62cc06d230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005880 tx=0x7f62d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:21.212 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.215+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f62d002e070 con 0x7f62e00712d0 2024-01-27T14:31:21.212 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.215+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f62d0076770 con 0x7f62e00712d0 2024-01-27T14:31:21.396 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.400+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62e0074360 con 0x7f62e00712d0 2024-01-27T14:31:21.441 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.445+0000 7f62dcff9640 1 -- 172.21.15.46:0/2504649055 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f62d0079d90 con 0x7f62e00712d0 2024-01-27T14:31:21.441 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-27T14:31:21.442 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:19.133133+0000","last_up_change":"0.000000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.447+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 msgr2=0x7f62cc06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.447+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 0x7f62cc06d230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005880 tx=0x7f62d4009040 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.447+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 msgr2=0x7f62e01e0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.447+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62d002b8e0 tx=0x7f62d00046c0 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 shutdown_connections 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f62cc06ad70 0x7f62cc06d230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e01582d0 0x7f62e0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e00712d0 0x7f62e01e0ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 --2- 172.21.15.46:0/2504649055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e0070ef0 0x7f62e014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:21.444 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 >> 172.21.15.46:0/2504649055 conn(0x7f62e006ad70 msgr2=0x7f62e0073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:21.445 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 shutdown_connections 2024-01-27T14:31:21.445 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:21.448+0000 7f62e6608640 1 -- 172.21.15.46:0/2504649055 wait complete. 2024-01-27T14:31:21.453 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-27T14:31:23.592 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T14:31:23.596+0000 7efc2ed9e640 -1 osd.4 0 log_to_monitors true 2024-01-27T14:31:23.635 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T14:31:23.639+0000 7fc49398f640 -1 osd.6 0 log_to_monitors true 2024-01-27T14:31:23.664 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:31:23.665+0000 7fcac64b5640 -1 osd.3 0 log_to_monitors true 2024-01-27T14:31:23.667 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T14:31:23.671+0000 7fd01298c640 -1 osd.5 0 log_to_monitors true 2024-01-27T14:31:23.701 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T14:31:23.704+0000 7ff9ce99e640 -1 osd.7 0 log_to_monitors true 2024-01-27T14:31:23.713 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:31:23.718+0000 7fa556ac8640 -1 osd.2 0 log_to_monitors true 2024-01-27T14:31:23.714 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:31:23.718+0000 7f72012d9640 -1 osd.1 0 log_to_monitors true 2024-01-27T14:31:23.718 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:23.722+0000 7fa939df6640 -1 osd.0 0 log_to_monitors true 2024-01-27T14:31:26.394 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T14:31:26.398+0000 7efc2ad2e640 -1 osd.4 0 waiting for initial osdmap 2024-01-27T14:31:26.492 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T14:31:26.495+0000 7fc48f91f640 -1 osd.6 0 waiting for initial osdmap 2024-01-27T14:31:26.600 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T14:31:26.604+0000 7efc22b55640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:26.601 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T14:31:26.605+0000 7fc487746640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:31:27.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:31:27.478 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T14:31:27.482+0000 7fd00e91c640 -1 osd.5 0 waiting for initial osdmap 2024-01-27T14:31:27.483 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T14:31:27.487+0000 7ff9ca92e640 -1 osd.7 0 waiting for initial osdmap 2024-01-27T14:31:27.504 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T14:31:27.508+0000 7ff9c2755640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.523 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T14:31:27.527+0000 7fd006743640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.617 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:31:27.619+0000 7fa55326c640 -1 osd.2 0 waiting for initial osdmap 2024-01-27T14:31:27.645 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:31:27.649+0000 7fa54a87f640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.668 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:31:27.672+0000 7f71fd269640 -1 osd.1 0 waiting for initial osdmap 2024-01-27T14:31:27.682 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:31:27.686+0000 7f71f5090640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.714 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:31:27.718+0000 7fcac2445640 -1 osd.3 0 waiting for initial osdmap 2024-01-27T14:31:27.749 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:27.753+0000 7fa935d86640 -1 osd.0 0 waiting for initial osdmap 2024-01-27T14:31:27.788 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:31:27.792+0000 7fa92dbad640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:27.797 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:31:27.802+0000 7fcaba26c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T14:31:28.260 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:28.351 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.355+0000 7f1e49c2f640 1 Processor -- start 2024-01-27T14:31:28.351 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.355+0000 7f1e49c2f640 1 -- start start 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e49c2f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 0x7f1e44157550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e49c2f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1e440c26c0 0x7f1e440c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e49c2f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440c3090 con 0x7f1e441516a0 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e49c2f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440c3920 con 0x7f1e440c26c0 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e49c2f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440c2230 con 0x7f1e440cd800 2024-01-27T14:31:28.352 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e441516a0 0x7f1e44070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:48854/0 (socket says 172.21.15.46:48854) 2024-01-27T14:31:28.353 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.356+0000 7f1e437fe640 1 -- 172.21.15.46:0/2380196906 learned_addr learned my addr 172.21.15.46:0/2380196906 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:28.354 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.359+0000 7f1e42ffd640 1 --2- 172.21.15.46:0/2380196906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 0x7f1e44157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:28.359 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.363+0000 7f1e42ffd640 1 -- 172.21.15.46:0/2380196906 >> v2:172.21.15.46:3300/0 conn(0x7f1e440c26c0 msgr2=0x7f1e440c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:28.359 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.363+0000 7f1e42ffd640 1 --2- 172.21.15.46:0/2380196906 >> v2:172.21.15.46:3300/0 conn(0x7f1e440c26c0 0x7f1e440c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.359 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.363+0000 7f1e42ffd640 1 -- 172.21.15.46:0/2380196906 >> v1:172.21.15.73:6789/0 conn(0x7f1e441516a0 legacy=0x7f1e44070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.359 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.363+0000 7f1e42ffd640 1 -- 172.21.15.46:0/2380196906 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44157c50 con 0x7f1e440cd800 2024-01-27T14:31:28.363 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.367+0000 7f1e42ffd640 1 --2- 172.21.15.46:0/2380196906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 0x7f1e44157550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097a0 tx=0x7f1e3402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977b0dc6c1a13773 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:28.369 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.373+0000 7f1e427fc640 1 -- 172.21.15.46:0/2380196906 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34030610 con 0x7f1e440cd800 2024-01-27T14:31:28.369 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.373+0000 7f1e427fc640 1 -- 172.21.15.46:0/2380196906 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34030770 con 0x7f1e440cd800 2024-01-27T14:31:28.369 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.373+0000 7f1e427fc640 1 -- 172.21.15.46:0/2380196906 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34030b00 con 0x7f1e440cd800 2024-01-27T14:31:28.370 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 -- 172.21.15.46:0/2380196906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 msgr2=0x7f1e44157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.370 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/2380196906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 0x7f1e44157550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097a0 tx=0x7f1e3402b960 comp rx=0 tx=0).stop 2024-01-27T14:31:28.370 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 -- 172.21.15.46:0/2380196906 shutdown_connections 2024-01-27T14:31:28.370 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/2380196906 >> v2:172.21.15.46:3300/0 conn(0x7f1e440c26c0 0x7f1e440c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.370 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/2380196906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440cd800 0x7f1e44157550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.371 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 -- 172.21.15.46:0/2380196906 >> 172.21.15.46:0/2380196906 conn(0x7f1e4406aed0 msgr2=0x7f1e4406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:28.371 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 -- 172.21.15.46:0/2380196906 shutdown_connections 2024-01-27T14:31:28.371 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.374+0000 7f1e49c2f640 1 -- 172.21.15.46:0/2380196906 wait complete. 2024-01-27T14:31:28.371 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.375+0000 7f1e49c2f640 1 Processor -- start 2024-01-27T14:31:28.371 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.375+0000 7f1e49c2f640 1 -- start start 2024-01-27T14:31:28.372 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.372 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e440cd800 0x7f1e44159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.373 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441516a0 0x7f1e44159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.373 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440ccf20 con 0x7f1e440cd800 2024-01-27T14:31:28.373 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441ed250 con 0x7f1e441516a0 2024-01-27T14:31:28.373 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.376+0000 7f1e49c2f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441ed530 con 0x7f1e440c26c0 2024-01-27T14:31:28.374 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.378+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:28.374 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.378+0000 7f1e43fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441516a0 0x7f1e44159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:28.375 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.379+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:33434/0 (socket says 172.21.15.46:33434) 2024-01-27T14:31:28.375 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.379+0000 7f1e437fe640 1 -- 172.21.15.46:0/1528302664 learned_addr learned my addr 172.21.15.46:0/1528302664 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:28.378 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.382+0000 7f1e437fe640 1 -- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441516a0 msgr2=0x7f1e44159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.378 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.382+0000 7f1e437fe640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441516a0 0x7f1e44159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.378 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.382+0000 7f1e437fe640 1 -- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e440cd800 msgr2=0x7f1e44159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.378 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.382+0000 7f1e437fe640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e440cd800 0x7f1e44159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.378 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.382+0000 7f1e437fe640 1 -- 172.21.15.46:0/1528302664 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009400 con 0x7f1e440c26c0 2024-01-27T14:31:28.380 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.384+0000 7f1e437fe640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c3c0 tx=0x7f1e2c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:28.384 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.388+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c005ce0 con 0x7f1e440c26c0 2024-01-27T14:31:28.384 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.388+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c005e40 con 0x7f1e440c26c0 2024-01-27T14:31:28.384 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.388+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0072d0 con 0x7f1e440c26c0 2024-01-27T14:31:28.384 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.388+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e441ed810 con 0x7f1e440c26c0 2024-01-27T14:31:28.384 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.388+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e441eddd0 con 0x7f1e440c26c0 2024-01-27T14:31:28.385 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.389+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44074360 con 0x7f1e440c26c0 2024-01-27T14:31:28.404 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.407+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f1e2c0074f0 con 0x7f1e440c26c0 2024-01-27T14:31:28.404 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.408+0000 7f1e3bfff640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 0x7f1e2406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:28.404 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.408+0000 7f1e42ffd640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 0x7f1e2406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:28.404 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.408+0000 7f1e42ffd640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 0x7f1e2406d350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1e34036000 tx=0x7f1e3403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:28.629 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.633+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f1e2c057c30 con 0x7f1e440c26c0 2024-01-27T14:31:28.639 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.643+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1e2c053f70 con 0x7f1e440c26c0 2024-01-27T14:31:28.823 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.827+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e441ed670 con 0x7f1e440c26c0 2024-01-27T14:31:28.873 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.877+0000 7f1e3bfff640 1 -- 172.21.15.46:0/1528302664 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7993 (secure 0 0 0) 0x7f1e441ed670 con 0x7f1e440c26c0 2024-01-27T14:31:28.874 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-27T14:31:28.874 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":14,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:27.667466+0000","last_up_change":"2024-01-27T14:31:27.667466+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 msgr2=0x7f1e2406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 0x7f1e2406d350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1e34036000 tx=0x7f1e3403b040 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 msgr2=0x7f1e4414bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c3c0 tx=0x7f1e2c00c880 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 shutdown_connections 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2406ae90 0x7f1e2406d350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e441516a0 0x7f1e44159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e440cd800 0x7f1e44159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 --2- 172.21.15.46:0/1528302664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e440c26c0 0x7f1e4414bbd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:28.876 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 >> 172.21.15.46:0/1528302664 conn(0x7f1e4406aed0 msgr2=0x7f1e440c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:28.877 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 shutdown_connections 2024-01-27T14:31:28.877 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:28.879+0000 7f1e49c2f640 1 -- 172.21.15.46:0/1528302664 wait complete. 2024-01-27T14:31:28.886 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-01-27T14:31:35.693 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:35.783 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.787+0000 7f90f1008640 1 Processor -- start 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.787+0000 7f90f1008640 1 -- start start 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.788+0000 7f90f1008640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90ec1506c0 0x7f90ec0c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.788+0000 7f90f1008640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 0x7f90ec06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.788+0000 7f90f1008640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0c7790 con 0x7f90ec0c68a0 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.788+0000 7f90f1008640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0705f0 con 0x7f90ec1506c0 2024-01-27T14:31:35.784 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.788+0000 7f90f1008640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c1400 con 0x7f90ec0c84c0 2024-01-27T14:31:35.785 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.789+0000 7f90eb59e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 0x7f90ec06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:35.785 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.789+0000 7f90ea59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f90ec0c68a0 0x7f90ec156390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:45094/0 (socket says 172.21.15.46:45094) 2024-01-27T14:31:35.785 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.789+0000 7f90ea59c640 1 -- 172.21.15.46:0/1428874383 learned_addr learned my addr 172.21.15.46:0/1428874383 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:35.785 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.789+0000 7f90ead9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90ec1506c0 0x7f90ec0c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:35.787 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.792+0000 7f90eb59e640 1 -- 172.21.15.46:0/1428874383 >> v2:172.21.15.73:3300/0 conn(0x7f90ec1506c0 msgr2=0x7f90ec0c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:35.788 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.792+0000 7f90eb59e640 1 --2- 172.21.15.46:0/1428874383 >> v2:172.21.15.73:3300/0 conn(0x7f90ec1506c0 0x7f90ec0c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:35.788 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.792+0000 7f90eb59e640 1 -- 172.21.15.46:0/1428874383 >> v1:172.21.15.73:6789/0 conn(0x7f90ec0c68a0 legacy=0x7f90ec156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:35.788 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.792+0000 7f90eb59e640 1 -- 172.21.15.46:0/1428874383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec150aa0 con 0x7f90ec0c84c0 2024-01-27T14:31:35.790 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.794+0000 7f90eb59e640 1 --2- 172.21.15.46:0/1428874383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 0x7f90ec06f9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90e400ba40 tx=0x7f90e402e080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c724b3b4d894ac6f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:35.794 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.798+0000 7f90e9d9b640 1 -- 172.21.15.46:0/1428874383 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e402ee30 con 0x7f90ec0c84c0 2024-01-27T14:31:35.794 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.798+0000 7f90e9d9b640 1 -- 172.21.15.46:0/1428874383 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4036440 con 0x7f90ec0c84c0 2024-01-27T14:31:35.794 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.798+0000 7f90e9d9b640 1 -- 172.21.15.46:0/1428874383 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40367d0 con 0x7f90ec0c84c0 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 -- 172.21.15.46:0/1428874383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 msgr2=0x7f90ec06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 --2- 172.21.15.46:0/1428874383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 0x7f90ec06f9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90e400ba40 tx=0x7f90e402e080 comp rx=0 tx=0).stop 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 -- 172.21.15.46:0/1428874383 shutdown_connections 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 --2- 172.21.15.46:0/1428874383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec0c84c0 0x7f90ec06f9d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 --2- 172.21.15.46:0/1428874383 >> v2:172.21.15.73:3300/0 conn(0x7f90ec1506c0 0x7f90ec0c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:35.795 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 -- 172.21.15.46:0/1428874383 >> 172.21.15.46:0/1428874383 conn(0x7f90ec0cbea0 msgr2=0x7f90ec0cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:35.796 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 -- 172.21.15.46:0/1428874383 shutdown_connections 2024-01-27T14:31:35.796 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.799+0000 7f90f1008640 1 -- 172.21.15.46:0/1428874383 wait complete. 2024-01-27T14:31:35.796 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.800+0000 7f90f1008640 1 Processor -- start 2024-01-27T14:31:35.796 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.800+0000 7f90f1008640 1 -- start start 2024-01-27T14:31:35.797 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90ec0c68a0 0x7f90ec0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:35.797 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 0x7f90ec155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec06f420 con 0x7f90ec0c68a0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1df7c0 con 0x7f90ec0c84c0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90f1008640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1dfa60 con 0x7f90ec1506c0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90eb59e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 0x7f90ec155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90ea59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90ead9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90ec0c68a0 0x7f90ec0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.801+0000 7f90ea59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50680/0 (socket says 172.21.15.46:50680) 2024-01-27T14:31:35.798 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.802+0000 7f90ea59c640 1 -- 172.21.15.46:0/2692315401 learned_addr learned my addr 172.21.15.46:0/2692315401 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:35.801 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90eb59e640 1 -- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 msgr2=0x7f90ec154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:35.801 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90eb59e640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:35.801 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90eb59e640 1 -- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90ec0c68a0 msgr2=0x7f90ec0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:35.801 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90eb59e640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90ec0c68a0 0x7f90ec0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:35.801 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90eb59e640 1 -- 172.21.15.46:0/2692315401 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e400b6a0 con 0x7f90ec1506c0 2024-01-27T14:31:35.802 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.805+0000 7f90ea59c640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:31:35.804 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.808+0000 7f90eb59e640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 0x7f90ec155290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90e4035000 tx=0x7f90e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:35.808 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.812+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4034850 con 0x7f90ec1506c0 2024-01-27T14:31:35.808 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.812+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40349b0 con 0x7f90ec1506c0 2024-01-27T14:31:35.808 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.812+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4034d40 con 0x7f90ec1506c0 2024-01-27T14:31:35.808 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.812+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0c4620 con 0x7f90ec1506c0 2024-01-27T14:31:35.809 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.812+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec1e2410 con 0x7f90ec1506c0 2024-01-27T14:31:35.809 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:35.813+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec154a70 con 0x7f90ec1506c0 2024-01-27T14:31:36.049 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.053+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f90e403d070 con 0x7f90ec1506c0 2024-01-27T14:31:36.050 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.053+0000 7f90e37fe640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 0x7f90cc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.050 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.054+0000 7f90ead9d640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 0x7f90cc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.050 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.054+0000 7f90ead9d640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 0x7f90cc06d3e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0113e0 tx=0x7f90dc00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:36.052 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.056+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90e407af80 con 0x7f90ec1506c0 2024-01-27T14:31:36.062 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.067+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f90e40772c0 con 0x7f90ec1506c0 2024-01-27T14:31:36.242 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.246+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90ec154a70 con 0x7f90ec1506c0 2024-01-27T14:31:36.328 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.333+0000 7f90e37fe640 1 -- 172.21.15.46:0/2692315401 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12755 (secure 0 0 0) 0x7f90ec154a70 con 0x7f90ec1506c0 2024-01-27T14:31:36.329 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-27T14:31:36.329 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":18,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:32.186931+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 msgr2=0x7f90cc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 0x7f90cc06d3e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0113e0 tx=0x7f90dc00b040 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 msgr2=0x7f90ec155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 0x7f90ec155290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90e4035000 tx=0x7f90e40046c0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 shutdown_connections 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f90cc06af20 0x7f90cc06d3e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec0c84c0 0x7f90ec154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f90ec1506c0 0x7f90ec155290 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 --2- 172.21.15.46:0/2692315401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90ec0c68a0 0x7f90ec0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.331 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 >> 172.21.15.46:0/2692315401 conn(0x7f90ec0cbea0 msgr2=0x7f90ec14e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:36.332 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 shutdown_connections 2024-01-27T14:31:36.332 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T14:31:36.334+0000 7f90f1008640 1 -- 172.21.15.46:0/2692315401 wait complete. 2024-01-27T14:31:36.340 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-27T14:31:36.340 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-27T14:31:36.340 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.341 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-27T14:31:36.341 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-27T14:31:36.343 INFO:tasks.ceph.mds.a:Started 2024-01-27T14:31:36.343 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.343 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-27T14:31:36.343 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-27T14:31:36.345 INFO:tasks.ceph.mds.c:Started 2024-01-27T14:31:36.345 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.345 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-27T14:31:36.346 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-27T14:31:36.347 INFO:tasks.ceph.mds.e:Started 2024-01-27T14:31:36.347 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.347 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-27T14:31:36.348 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-27T14:31:36.350 INFO:tasks.ceph.mds.b:Started 2024-01-27T14:31:36.350 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.350 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-27T14:31:36.350 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-27T14:31:36.352 INFO:tasks.ceph.mds.d:Started 2024-01-27T14:31:36.352 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T14:31:36.353 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-27T14:31:36.353 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-27T14:31:36.354 INFO:tasks.ceph.mds.f:Started 2024-01-27T14:31:36.355 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-27T14:31:36.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:36.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.465+0000 7f489aaa6640 1 Processor -- start 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.465+0000 7f489aaa6640 1 -- start start 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 0x7f48940c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48940c8460 0x7f48941514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c90c0 0x7f4894151a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4894158250 con 0x7f48940c8460 2024-01-27T14:31:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4894158530 con 0x7f48940c8080 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.466+0000 7f489aaa6640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489415ac60 con 0x7f48940c90c0 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4893fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48940c8460 0x7f48941514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4898842640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 0x7f48940c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4899043640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c90c0 0x7f4894151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4898842640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 0x7f48940c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50688/0 (socket says 172.21.15.46:50688) 2024-01-27T14:31:36.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4893fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48940c8460 0x7f48941514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33398/0 (socket says 172.21.15.46:33398) 2024-01-27T14:31:36.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.467+0000 7f4898842640 1 -- 172.21.15.46:0/2945598386 learned_addr learned my addr 172.21.15.46:0/2945598386 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:36.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.470+0000 7f4893fff640 1 -- 172.21.15.46:0/2945598386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c90c0 msgr2=0x7f4894151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:36.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.470+0000 7f4893fff640 1 --2- 172.21.15.46:0/2945598386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c90c0 0x7f4894151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.470+0000 7f4893fff640 1 -- 172.21.15.46:0/2945598386 >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 msgr2=0x7f48940c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:36.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.470+0000 7f4893fff640 1 --2- 172.21.15.46:0/2945598386 >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 0x7f48940c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.470+0000 7f4893fff640 1 -- 172.21.15.46:0/2945598386 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489415af40 con 0x7f48940c8460 2024-01-27T14:31:36.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.473+0000 7f4893fff640 1 --2- 172.21.15.46:0/2945598386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c8460 0x7f48941514e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4894072cc0 tx=0x7f488002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6f4ace4b73ba6c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:36.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.478+0000 7f48937fe640 1 -- 172.21.15.46:0/2945598386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488002e070 con 0x7f48940c8460 2024-01-27T14:31:36.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.478+0000 7f48937fe640 1 -- 172.21.15.46:0/2945598386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800315a0 con 0x7f48940c8460 2024-01-27T14:31:36.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.478+0000 7f48937fe640 1 -- 172.21.15.46:0/2945598386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880031930 con 0x7f48940c8460 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 -- 172.21.15.46:0/2945598386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c8460 msgr2=0x7f48941514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 --2- 172.21.15.46:0/2945598386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c8460 0x7f48941514e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4894072cc0 tx=0x7f488002b840 comp rx=0 tx=0).stop 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 -- 172.21.15.46:0/2945598386 shutdown_connections 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 --2- 172.21.15.46:0/2945598386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c90c0 0x7f4894151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 --2- 172.21.15.46:0/2945598386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c8460 0x7f48941514e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 --2- 172.21.15.46:0/2945598386 >> v2:172.21.15.73:3300/0 conn(0x7f48940c8080 0x7f48940c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 -- 172.21.15.46:0/2945598386 >> 172.21.15.46:0/2945598386 conn(0x7f4894070e40 msgr2=0x7f4894071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 -- 172.21.15.46:0/2945598386 shutdown_connections 2024-01-27T14:31:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.479+0000 7f489aaa6640 1 -- 172.21.15.46:0/2945598386 wait complete. 2024-01-27T14:31:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.480+0000 7f489aaa6640 1 Processor -- start 2024-01-27T14:31:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.480+0000 7f489aaa6640 1 -- start start 2024-01-27T14:31:36.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c8080 0x7f48940af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 0x7f489414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 0x7f48940b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940cc880 con 0x7f48940c90c0 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489414b290 con 0x7f48940c8460 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.481+0000 7f489aaa6640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940af7f0 con 0x7f48940c8080 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.482+0000 7f4899043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 0x7f48940b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.482+0000 7f4898842640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c8080 0x7f48940af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.482+0000 7f4893fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 0x7f489414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.482+0000 7f4899043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 0x7f48940b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33410/0 (socket says 172.21.15.46:33410) 2024-01-27T14:31:36.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.482+0000 7f4899043640 1 -- 172.21.15.46:0/427437958 learned_addr learned my addr 172.21.15.46:0/427437958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.487+0000 7f4893fff640 1 -- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c8080 msgr2=0x7f48940af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.487+0000 7f4893fff640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c8080 0x7f48940af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.487+0000 7f4893fff640 1 -- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 msgr2=0x7f48940b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:36.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.487+0000 7f4893fff640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 0x7f48940b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:36.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.487+0000 7f4893fff640 1 -- 172.21.15.46:0/427437958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009400 con 0x7f48940c8460 2024-01-27T14:31:36.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.491+0000 7f4893fff640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 0x7f489414ad50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4880033000 tx=0x7f48800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.495+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880032840 con 0x7f48940c8460 2024-01-27T14:31:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.495+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880031f00 con 0x7f48940c8460 2024-01-27T14:31:36.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.495+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489415bba0 con 0x7f48940c8460 2024-01-27T14:31:36.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.495+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48940cbee0 con 0x7f48940c8460 2024-01-27T14:31:36.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.495+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880032bc0 con 0x7f48940c8460 2024-01-27T14:31:36.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.496+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48940742e0 con 0x7f48940c8460 2024-01-27T14:31:36.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.751+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4880032d20 con 0x7f48940c8460 2024-01-27T14:31:36.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.752+0000 7f48917fa640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 0x7f487806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:36.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.752+0000 7f4898842640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 0x7f487806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:36.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.752+0000 7f4898842640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 0x7f487806d410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4888006cc0 tx=0x7f4888009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.755+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f488007a240 con 0x7f48940c8460 2024-01-27T14:31:36.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:36.767+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4880076580 con 0x7f48940c8460 2024-01-27T14:31:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.001+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48940afd30 con 0x7f48940c8460 2024-01-27T14:31:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.095+0000 7f48917fa640 1 -- 172.21.15.46:0/427437958 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12755 (secure 0 0 0) 0x7f4880079ba0 con 0x7f48940c8460 2024-01-27T14:31:37.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:37.092 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:32.186931+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.097+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 msgr2=0x7f487806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.097+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 0x7f487806d410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4888006cc0 tx=0x7f4888009240 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.097+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 msgr2=0x7f489414ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.097+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 0x7f489414ad50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4880033000 tx=0x7f48800046c0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.097+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 shutdown_connections 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f487806af50 0x7f487806d410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48940c8460 0x7f489414ad50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48940c90c0 0x7f48940b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 --2- 172.21.15.46:0/427437958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48940c8080 0x7f48940af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 >> 172.21.15.46:0/427437958 conn(0x7f4894070e40 msgr2=0x7f48940c1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 shutdown_connections 2024-01-27T14:31:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.098+0000 7f489aaa6640 1 -- 172.21.15.46:0/427437958 wait complete. 2024-01-27T14:31:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-27T14:31:37.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:31:37.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.217+0000 7fb798207640 1 Processor -- start 2024-01-27T14:31:37.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.217+0000 7fb798207640 1 -- start start 2024-01-27T14:31:37.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.218+0000 7fb798207640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb790151810 0x7fb7900ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.218+0000 7fb798207640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7900c9380 0x7fb79015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.218+0000 7fb798207640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79015aad0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.218+0000 7fb798207640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb790158500 con 0x7fb790151810 2024-01-27T14:31:37.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.218+0000 7fb798207640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79015b090 con 0x7fb7900c9380 2024-01-27T14:31:37.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.219+0000 7fb795fa3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb790151810 0x7fb7900ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.219+0000 7fb7957a2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb7900ca3d0 0x7fb790070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33950/0 (socket says 172.21.15.46:33950) 2024-01-27T14:31:37.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.219+0000 7fb7957a2640 1 -- 172.21.15.46:0/3061635331 learned_addr learned my addr 172.21.15.46:0/3061635331 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:37.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.221+0000 7fb795fa3640 1 -- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7900c9380 msgr2=0x7fb79015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:37.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.221+0000 7fb795fa3640 1 --2- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7900c9380 0x7fb79015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.221+0000 7fb795fa3640 1 -- 172.21.15.46:0/3061635331 >> v1:172.21.15.46:6789/0 conn(0x7fb7900ca3d0 legacy=0x7fb790070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.222+0000 7fb795fa3640 1 -- 172.21.15.46:0/3061635331 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790157c60 con 0x7fb790151810 2024-01-27T14:31:37.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.224+0000 7fb795fa3640 1 --2- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790151810 0x7fb7900ccd10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097a0 tx=0x7fb78c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f534f11ff8b4e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.228+0000 7fb794fa1640 1 -- 172.21.15.46:0/3061635331 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c030610 con 0x7fb790151810 2024-01-27T14:31:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.228+0000 7fb794fa1640 1 -- 172.21.15.46:0/3061635331 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c030770 con 0x7fb790151810 2024-01-27T14:31:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.228+0000 7fb794fa1640 1 -- 172.21.15.46:0/3061635331 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c030b00 con 0x7fb790151810 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 -- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790151810 msgr2=0x7fb7900ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 --2- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790151810 0x7fb7900ccd10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097a0 tx=0x7fb78c02b960 comp rx=0 tx=0).stop 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 -- 172.21.15.46:0/3061635331 shutdown_connections 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 --2- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7900c9380 0x7fb79015b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 --2- 172.21.15.46:0/3061635331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb790151810 0x7fb7900ccd10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 -- 172.21.15.46:0/3061635331 >> 172.21.15.46:0/3061635331 conn(0x7fb790066c80 msgr2=0x7fb79006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 -- 172.21.15.46:0/3061635331 shutdown_connections 2024-01-27T14:31:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.229+0000 7fb798207640 1 -- 172.21.15.46:0/3061635331 wait complete. 2024-01-27T14:31:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.230+0000 7fb798207640 1 Processor -- start 2024-01-27T14:31:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.230+0000 7fb798207640 1 -- start start 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7900c9380 0x7fb79006c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb790151810 0x7fb7901ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b1600 con 0x7fb7900c9380 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790157230 con 0x7fb7900ca3d0 2024-01-27T14:31:37.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb798207640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb790157510 con 0x7fb790151810 2024-01-27T14:31:37.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.231+0000 7fb7957a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.232+0000 7fb795fa3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7900c9380 0x7fb79006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.232+0000 7fb7957a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50706/0 (socket says 172.21.15.46:50706) 2024-01-27T14:31:37.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.232+0000 7fb7957a2640 1 -- 172.21.15.46:0/837244541 learned_addr learned my addr 172.21.15.46:0/837244541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.235+0000 7fb7957a2640 1 -- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb790151810 msgr2=0x7fb7901ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.235+0000 7fb7957a2640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb790151810 0x7fb7901ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.235+0000 7fb7957a2640 1 -- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7900c9380 msgr2=0x7fb79006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.235+0000 7fb7957a2640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7900c9380 0x7fb79006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.235+0000 7fb7957a2640 1 -- 172.21.15.46:0/837244541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009400 con 0x7fb7900ca3d0 2024-01-27T14:31:37.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.238+0000 7fb7957a2640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c440 tx=0x7fb780001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.243+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780005ce0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.243+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780005e40 con 0x7fb7900ca3d0 2024-01-27T14:31:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.243+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900c45c0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.243+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800072f0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.243+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900b12a0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.244+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79015a0e0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.274+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb7800074d0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.274+0000 7fb7867fc640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 0x7fb77406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.274+0000 7fb795fa3640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 0x7fb77406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.275+0000 7fb795fa3640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 0x7fb77406d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb78c036000 tx=0x7fb78c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:37.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.280+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb780057ad0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.555+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb780053e10 con 0x7fb7900ca3d0 2024-01-27T14:31:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.736+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb79015a0e0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.758+0000 7fb7867fc640 1 -- 172.21.15.46:0/837244541 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb79015a0e0 con 0x7fb7900ca3d0 2024-01-27T14:31:37.754 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 msgr2=0x7fb77406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 0x7fb77406d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb78c036000 tx=0x7fb78c008030 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 msgr2=0x7fb79015a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c440 tx=0x7fb780001e70 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 shutdown_connections 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb77406aed0 0x7fb77406d390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7900ca3d0 0x7fb79015a3c0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c440 tx=0x7fb780001e70 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb790151810 0x7fb7901ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 --2- 172.21.15.46:0/837244541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7900c9380 0x7fb79006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 >> 172.21.15.46:0/837244541 conn(0x7fb790066c80 msgr2=0x7fb790070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 shutdown_connections 2024-01-27T14:31:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.760+0000 7fb798207640 1 -- 172.21.15.46:0/837244541 wait complete. 2024-01-27T14:31:37.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:31:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.882+0000 7f9c12df5640 1 Processor -- start 2024-01-27T14:31:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.882+0000 7f9c12df5640 1 -- start start 2024-01-27T14:31:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.883+0000 7f9c12df5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c14d360 0x7f9c0c0c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.883+0000 7f9c12df5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9c0c1563a0 0x7f9c0c156830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.883+0000 7f9c12df5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0c6e20 con 0x7f9c0c06ef40 2024-01-27T14:31:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.883+0000 7f9c12df5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c15a2f0 con 0x7f9c0c1563a0 2024-01-27T14:31:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.883+0000 7f9c12df5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0c1400 con 0x7f9c0c14d360 2024-01-27T14:31:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.884+0000 7f9c0bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c0c06ef40 0x7f9c0c0c28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33962/0 (socket says 172.21.15.46:33962) 2024-01-27T14:31:37.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.884+0000 7f9c0bfff640 1 -- 172.21.15.46:0/2512691140 learned_addr learned my addr 172.21.15.46:0/2512691140 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.885+0000 7f9c11392640 1 --2- 172.21.15.46:0/2512691140 >> v2:172.21.15.46:3300/0 conn(0x7f9c0c1563a0 0x7f9c0c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.886+0000 7f9c10b91640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c14d360 0x7f9c0c0c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.889+0000 7f9c0b7fe640 1 -- 172.21.15.46:0/2512691140 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199836813 0 0) 0x7f9c0c0c6e20 con 0x7f9c0c06ef40 2024-01-27T14:31:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.889+0000 7f9c0b7fe640 1 -- 172.21.15.46:0/2512691140 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bfc003520 con 0x7f9c0c06ef40 2024-01-27T14:31:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.892+0000 7f9c11392640 1 -- 172.21.15.46:0/2512691140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c14d360 msgr2=0x7f9c0c0c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.892+0000 7f9c11392640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c14d360 0x7f9c0c0c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.892+0000 7f9c11392640 1 -- 172.21.15.46:0/2512691140 >> v1:172.21.15.46:6789/0 conn(0x7f9c0c06ef40 legacy=0x7f9c0c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.892+0000 7f9c11392640 1 -- 172.21.15.46:0/2512691140 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0c68a0 con 0x7f9c0c1563a0 2024-01-27T14:31:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.902+0000 7f9c11392640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c156830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009dc0 tx=0x7f9c0402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cac0f89b5c4acd server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.908+0000 7f9c0b7fe640 1 -- 172.21.15.46:0/2512691140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0402ccd0 con 0x7f9c0c1563a0 2024-01-27T14:31:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.908+0000 7f9c0b7fe640 1 -- 172.21.15.46:0/2512691140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0402ce30 con 0x7f9c0c1563a0 2024-01-27T14:31:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.908+0000 7f9c0b7fe640 1 -- 172.21.15.46:0/2512691140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04034660 con 0x7f9c0c1563a0 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.908+0000 7f9c12df5640 1 -- 172.21.15.46:0/2512691140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 msgr2=0x7f9c0c156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.908+0000 7f9c12df5640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c156830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009dc0 tx=0x7f9c0402bf20 comp rx=0 tx=0).stop 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 -- 172.21.15.46:0/2512691140 shutdown_connections 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c156830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 --2- 172.21.15.46:0/2512691140 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c14d360 0x7f9c0c0c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 -- 172.21.15.46:0/2512691140 >> 172.21.15.46:0/2512691140 conn(0x7f9c0c072750 msgr2=0x7f9c0c06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 -- 172.21.15.46:0/2512691140 shutdown_connections 2024-01-27T14:31:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.909+0000 7f9c12df5640 1 -- 172.21.15.46:0/2512691140 wait complete. 2024-01-27T14:31:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.910+0000 7f9c12df5640 1 Processor -- start 2024-01-27T14:31:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.910+0000 7f9c12df5640 1 -- start start 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c06ef40 0x7f9c0c1ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c0c14d360 0x7f9c0c142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c141940 con 0x7f9c0c1563a0 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c155ab0 con 0x7f9c0c14d360 2024-01-27T14:31:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c12df5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c153df0 con 0x7f9c0c06ef40 2024-01-27T14:31:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.911+0000 7f9c11392640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.912+0000 7f9c11392640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33440/0 (socket says 172.21.15.46:33440) 2024-01-27T14:31:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.912+0000 7f9c11392640 1 -- 172.21.15.46:0/1999802711 learned_addr learned my addr 172.21.15.46:0/1999802711 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.917+0000 7f9c11392640 1 -- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c06ef40 msgr2=0x7f9c0c1ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.917+0000 7f9c11392640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c06ef40 0x7f9c0c1ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.917+0000 7f9c11392640 1 -- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c0c14d360 msgr2=0x7f9c0c142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.917+0000 7f9c11392640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c0c14d360 0x7f9c0c142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.917+0000 7f9c11392640 1 -- 172.21.15.46:0/1999802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009a70 con 0x7f9c0c1563a0 2024-01-27T14:31:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.921+0000 7f9c11392640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402dfd0 tx=0x7f9c04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.924+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0403d600 con 0x7f9c0c1563a0 2024-01-27T14:31:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.924+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c1ee6c0 con 0x7f9c0c1563a0 2024-01-27T14:31:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.924+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c146680 con 0x7f9c0c1563a0 2024-01-27T14:31:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.925+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c066f20 con 0x7f9c0c1563a0 2024-01-27T14:31:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.927+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04009450 con 0x7f9c0c1563a0 2024-01-27T14:31:37.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:37.927+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0403d960 con 0x7f9c0c1563a0 2024-01-27T14:31:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.211+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9c0403b040 con 0x7f9c0c1563a0 2024-01-27T14:31:38.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.211+0000 7f9c097fa640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 0x7f9bf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:38.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.212+0000 7f9c10b91640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 0x7f9bf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:38.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.212+0000 7f9c10b91640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 0x7f9bf006d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.236+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c0407b030 con 0x7f9c0c1563a0 2024-01-27T14:31:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.236+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9c04076c70 con 0x7f9c0c1563a0 2024-01-27T14:31:38.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.459+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c0c06f3e0 con 0x7f9c0c1563a0 2024-01-27T14:31:38.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.473+0000 7f9c097fa640 1 -- 172.21.15.46:0/1999802711 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f9c0404e090 con 0x7f9c0c1563a0 2024-01-27T14:31:38.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:38.469 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-27T14:31:38.469 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 msgr2=0x7f9bf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 0x7f9bf006d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00008040 comp rx=0 tx=0).stop 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 msgr2=0x7f9c0c13e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402dfd0 tx=0x7f9c04004a40 comp rx=0 tx=0).stop 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 shutdown_connections 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9bf006aed0 0x7f9bf006d390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c0c14d360 0x7f9c0c142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c0c1563a0 0x7f9c0c13e8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:38.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 --2- 172.21.15.46:0/1999802711 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c0c06ef40 0x7f9c0c1ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:38.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 >> 172.21.15.46:0/1999802711 conn(0x7f9c0c072750 msgr2=0x7f9c0c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:38.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 shutdown_connections 2024-01-27T14:31:38.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:38.476+0000 7f9c12df5640 1 -- 172.21.15.46:0/1999802711 wait complete. 2024-01-27T14:31:40.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:31:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.593+0000 7f4099c65640 1 Processor -- start 2024-01-27T14:31:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.593+0000 7f4099c65640 1 -- start start 2024-01-27T14:31:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.594+0000 7f4099c65640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40940c8080 0x7f40940c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.594+0000 7f4099c65640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4094158250 con 0x7f40940c8460 2024-01-27T14:31:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.594+0000 7f4099c65640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4094158530 con 0x7f40940c90c0 2024-01-27T14:31:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.594+0000 7f4099c65640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409415ac60 con 0x7f40940c8080 2024-01-27T14:31:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.595+0000 7f4092ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f40940c8460 0x7f40941514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33972/0 (socket says 172.21.15.46:33972) 2024-01-27T14:31:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.595+0000 7f4092ffd640 1 -- 172.21.15.46:0/3388040808 learned_addr learned my addr 172.21.15.46:0/3388040808 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.595+0000 7f40937fe640 1 --2- 172.21.15.46:0/3388040808 >> v2:172.21.15.73:3300/0 conn(0x7f40940c8080 0x7f40940c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:40.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.599+0000 7f40927fc640 1 -- 172.21.15.46:0/3388040808 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265844528 0 0) 0x7f4094158250 con 0x7f40940c8460 2024-01-27T14:31:40.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.599+0000 7f40927fc640 1 -- 172.21.15.46:0/3388040808 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c003520 con 0x7f40940c8460 2024-01-27T14:31:40.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.599+0000 7f40937fe640 1 -- 172.21.15.46:0/3388040808 >> v1:172.21.15.73:6789/0 conn(0x7f40940c90c0 legacy=0x7f4094157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.599+0000 7f40937fe640 1 -- 172.21.15.46:0/3388040808 >> v1:172.21.15.46:6789/0 conn(0x7f40940c8460 legacy=0x7f40941514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.599+0000 7f40937fe640 1 -- 172.21.15.46:0/3388040808 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409415af40 con 0x7f40940c8080 2024-01-27T14:31:40.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.605+0000 7f40937fe640 1 --2- 172.21.15.46:0/3388040808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f40940c1fc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f40840097d0 tx=0x7f408402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb610c9b738f9f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f40927fc640 1 -- 172.21.15.46:0/3388040808 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084030610 con 0x7f40940c8080 2024-01-27T14:31:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f40927fc640 1 -- 172.21.15.46:0/3388040808 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084030770 con 0x7f40940c8080 2024-01-27T14:31:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f40927fc640 1 -- 172.21.15.46:0/3388040808 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084030b00 con 0x7f40940c8080 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 -- 172.21.15.46:0/3388040808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 msgr2=0x7f40940c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 --2- 172.21.15.46:0/3388040808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f40940c1fc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f40840097d0 tx=0x7f408402b960 comp rx=0 tx=0).stop 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 -- 172.21.15.46:0/3388040808 shutdown_connections 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 --2- 172.21.15.46:0/3388040808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f40940c1fc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 -- 172.21.15.46:0/3388040808 >> 172.21.15.46:0/3388040808 conn(0x7f4094070e40 msgr2=0x7f4094071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 -- 172.21.15.46:0/3388040808 shutdown_connections 2024-01-27T14:31:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.612+0000 7f4099c65640 1 -- 172.21.15.46:0/3388040808 wait complete. 2024-01-27T14:31:40.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.614+0000 7f4099c65640 1 Processor -- start 2024-01-27T14:31:40.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.614+0000 7f4099c65640 1 -- start start 2024-01-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f4094149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40940c90c0 0x7f409414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941ed3d0 con 0x7f40940c90c0 2024-01-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941f18b0 con 0x7f40940c8080 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4099c65640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40941ed5e0 con 0x7f40940c8460 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.616+0000 7f40937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f4094149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.617+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57482/0 (socket says 172.21.15.46:57482) 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.617+0000 7f4092ffd640 1 -- 172.21.15.46:0/534885688 learned_addr learned my addr 172.21.15.46:0/534885688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.617+0000 7f40937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f4094149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50746/0 (socket says 172.21.15.46:50746) 2024-01-27T14:31:40.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.620+0000 7f4092ffd640 1 -- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 msgr2=0x7f4094149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:40.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.620+0000 7f4092ffd640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f4094149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:40.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.620+0000 7f4092ffd640 1 -- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40940c90c0 msgr2=0x7f409414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:40.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.620+0000 7f4092ffd640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40940c90c0 0x7f409414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:40.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.620+0000 7f4092ffd640 1 -- 172.21.15.46:0/534885688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084009400 con 0x7f40940c8460 2024-01-27T14:31:40.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.623+0000 7f4092ffd640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f408800c430 tx=0x7f408800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:40.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.626+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088005ce0 con 0x7f40940c8460 2024-01-27T14:31:40.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.626+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409415bba0 con 0x7f40940c8460 2024-01-27T14:31:40.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.626+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40941edb60 con 0x7f40940c8460 2024-01-27T14:31:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.627+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409414e860 con 0x7f40940c8460 2024-01-27T14:31:40.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.629+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4088007e80 con 0x7f40940c8460 2024-01-27T14:31:40.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.629+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880072d0 con 0x7f40940c8460 2024-01-27T14:31:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.891+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4088007430 con 0x7f40940c8460 2024-01-27T14:31:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.891+0000 7f407bfff640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 0x7f408006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.892+0000 7f40937fe640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 0x7f408006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.892+0000 7f40937fe640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 0x7f408006d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4084036000 tx=0x7f4084008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:40.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.897+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4088005e40 con 0x7f40940c8460 2024-01-27T14:31:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:40.915+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f40880543c0 con 0x7f40940c8460 2024-01-27T14:31:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.134+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40940742e0 con 0x7f40940c8460 2024-01-27T14:31:41.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.163+0000 7f407bfff640 1 -- 172.21.15.46:0/534885688 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f4088021020 con 0x7f40940c8460 2024-01-27T14:31:41.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:41.159 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-27T14:31:41.159 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 msgr2=0x7f408006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 0x7f408006d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4084036000 tx=0x7f4084008030 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 msgr2=0x7f409414be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f408800c430 tx=0x7f408800c8f0 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 shutdown_connections 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f408006aed0 0x7f408006d390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40940c90c0 0x7f409414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40940c8460 0x7f409414be80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 --2- 172.21.15.46:0/534885688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40940c8080 0x7f4094149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:41.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 >> 172.21.15.46:0/534885688 conn(0x7f4094070e40 msgr2=0x7f40940c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:41.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 shutdown_connections 2024-01-27T14:31:41.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:41.165+0000 7f4099c65640 1 -- 172.21.15.46:0/534885688 wait complete. 2024-01-27T14:31:42.623 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2024-01-27T14:31:42.645 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2024-01-27T14:31:42.773 INFO:tasks.ceph.mds.e.smithi046.stdout:starting mds.e at 2024-01-27T14:31:42.781 INFO:tasks.ceph.mds.f.smithi073.stdout:starting mds.f at 2024-01-27T14:31:42.877 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-01-27T14:31:42.884 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-01-27T14:31:43.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:31:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.299+0000 7f7181f7c640 1 Processor -- start 2024-01-27T14:31:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.299+0000 7f7181f7c640 1 -- start start 2024-01-27T14:31:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.300+0000 7f7181f7c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 0x7f717c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.300+0000 7f7181f7c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0c7be0 con 0x7f717c1516a0 2024-01-27T14:31:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.300+0000 7f7181f7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0708a0 con 0x7f717c0c7790 2024-01-27T14:31:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.300+0000 7f7181f7c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c15aef0 con 0x7f717c0c9d10 2024-01-27T14:31:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.301+0000 7f717b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f717c1516a0 0x7f717c15b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33984/0 (socket says 172.21.15.46:33984) 2024-01-27T14:31:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.301+0000 7f717b7fe640 1 -- 172.21.15.46:0/1717910917 learned_addr learned my addr 172.21.15.46:0/1717910917 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.304+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884354670 0 0) 0x7f717c0c7be0 con 0x7f717c1516a0 2024-01-27T14:31:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.304+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168003520 con 0x7f717c1516a0 2024-01-27T14:31:43.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.307+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774293089 0 0) 0x7f7168003520 con 0x7f717c1516a0 2024-01-27T14:31:43.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.307+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 msgr2=0x7f717c0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:43.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.307+0000 7f717a7fc640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 0x7f717c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 >> v1:172.21.15.73:6789/0 conn(0x7f717c0c7790 legacy=0x7f717c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0c7e40 con 0x7f717c1516a0 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f716c001690 con 0x7f717c1516a0 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 >> v1:172.21.15.46:6789/0 conn(0x7f717c1516a0 legacy=0x7f717c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71680039a0 0x7f7168003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 0x7f71680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7168004e20 0x7f716800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c15aef0 con 0x7f7168004e20 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680054d0 con 0x7f71680039a0 2024-01-27T14:31:43.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.308+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7168005690 con 0x7f717c0c9d10 2024-01-27T14:31:43.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.309+0000 7f717bfff640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7168004e20 0x7f716800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:43.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.313+0000 7f717bfff640 1 -- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 msgr2=0x7f71680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:43.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.313+0000 7f717bfff640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0c9d10 0x7f71680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.313+0000 7f717bfff640 1 -- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71680039a0 msgr2=0x7f7168003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:43.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.313+0000 7f717bfff640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71680039a0 0x7f7168003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.313+0000 7f717bfff640 1 -- 172.21.15.46:0/1717910917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168003520 con 0x7f7168004e20 2024-01-27T14:31:43.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.315+0000 7f717bfff640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7168004e20 0x7f716800b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7174009e40 tx=0x7f71680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48da24fab025fdf server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:43.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.320+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717402cd90 con 0x7f7168004e20 2024-01-27T14:31:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.320+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174034440 con 0x7f7168004e20 2024-01-27T14:31:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.320+0000 7f717a7fc640 1 -- 172.21.15.46:0/1717910917 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740347f0 con 0x7f7168004e20 2024-01-27T14:31:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 -- 172.21.15.46:0/1717910917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7168004e20 msgr2=0x7f716800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 --2- 172.21.15.46:0/1717910917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7168004e20 0x7f716800b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7174009e40 tx=0x7f71680057f0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f717bfff640 1 -- 172.21.15.46:0/1717910917 reap_dead start 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 -- 172.21.15.46:0/1717910917 shutdown_connections 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 -- 172.21.15.46:0/1717910917 >> 172.21.15.46:0/1717910917 conn(0x7f717c06aae0 msgr2=0x7f717c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 -- 172.21.15.46:0/1717910917 shutdown_connections 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.321+0000 7f7181f7c640 1 -- 172.21.15.46:0/1717910917 wait complete. 2024-01-27T14:31:43.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.323+0000 7f7181f7c640 1 Processor -- start 2024-01-27T14:31:43.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.323+0000 7f7181f7c640 1 -- start start 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0caee0 0x7f717c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f717c0cb2c0 0x7f717c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0ca660 con 0x7f717c0cb2c0 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1e1e00 con 0x7f717c156b30 2024-01-27T14:31:43.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f7181f7c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c158190 con 0x7f717c0caee0 2024-01-27T14:31:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f717affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f717affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50830/0 (socket says 172.21.15.46:50830) 2024-01-27T14:31:43.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.324+0000 7f717affd640 1 -- 172.21.15.46:0/2548085273 learned_addr learned my addr 172.21.15.46:0/2548085273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:43.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.328+0000 7f717affd640 1 -- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0caee0 msgr2=0x7f717c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.328+0000 7f717affd640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0caee0 0x7f717c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.328+0000 7f717affd640 1 -- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f717c0cb2c0 msgr2=0x7f717c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.328+0000 7f717affd640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f717c0cb2c0 0x7f717c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.328+0000 7f717affd640 1 -- 172.21.15.46:0/2548085273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c148740 con 0x7f717c156b30 2024-01-27T14:31:43.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.330+0000 7f717affd640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f716400c390 tx=0x7f716400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:43.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.334+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640035f0 con 0x7f717c156b30 2024-01-27T14:31:43.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.334+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164003750 con 0x7f717c156b30 2024-01-27T14:31:43.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.334+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c06b7d0 con 0x7f717c156b30 2024-01-27T14:31:43.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.334+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164003b40 con 0x7f717c156b30 2024-01-27T14:31:43.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.334+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c1e1180 con 0x7f717c156b30 2024-01-27T14:31:43.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.335+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c1e1f40 con 0x7f717c156b30 2024-01-27T14:31:43.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.354+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7164003ca0 con 0x7f717c156b30 2024-01-27T14:31:43.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.355+0000 7f7173fff640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 0x7f715c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:43.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.355+0000 7f717b7fe640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 0x7f715c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:43.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.355+0000 7f717b7fe640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 0x7f715c06d390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f717c06f2f0 tx=0x7f716c001570 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:43.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.583+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71640581a0 con 0x7f717c156b30 2024-01-27T14:31:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.593+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7164053de0 con 0x7f717c156b30 2024-01-27T14:31:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.809+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f717c1e1f40 con 0x7f717c156b30 2024-01-27T14:31:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.865+0000 7f7173fff640 1 -- 172.21.15.46:0/2548085273 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f717c1e1f40 con 0x7f717c156b30 2024-01-27T14:31:43.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:43.862 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-27T14:31:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-01-27T14:31:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 msgr2=0x7f715c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 0x7f715c06d390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f717c06f2f0 tx=0x7f716c001570 comp rx=0 tx=0).stop 2024-01-27T14:31:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 msgr2=0x7f717c147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f716400c390 tx=0x7f716400c850 comp rx=0 tx=0).stop 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 shutdown_connections 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f715c06aed0 0x7f715c06d390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f717c156b30 0x7f717c147cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f717c0cb2c0 0x7f717c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 --2- 172.21.15.46:0/2548085273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f717c0caee0 0x7f717c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 >> 172.21.15.46:0/2548085273 conn(0x7f717c06aae0 msgr2=0x7f717c150950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 shutdown_connections 2024-01-27T14:31:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:43.867+0000 7f7181f7c640 1 -- 172.21.15.46:0/2548085273 wait complete. 2024-01-27T14:31:45.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:31:45.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.981+0000 7fe450a23640 1 Processor -- start 2024-01-27T14:31:45.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.981+0000 7fe450a23640 1 -- start start 2024-01-27T14:31:45.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe450a23640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe44c0cf2c0 0x7fe44c0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:45.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe450a23640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe44c0ca600 0x7fe44c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:45.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe450a23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c0b3280 con 0x7fe44c153b00 2024-01-27T14:31:45.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe450a23640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c15a8a0 con 0x7fe44c0ca600 2024-01-27T14:31:45.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe450a23640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c0caa10 con 0x7fe44c0cf2c0 2024-01-27T14:31:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe44ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe44c0ca600 0x7fe44c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.982+0000 7fe443fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe44c0cf2c0 0x7fe44c0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.983+0000 7fe44ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe44c0ca600 0x7fe44c0b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32868/0 (socket says 172.21.15.46:32868) 2024-01-27T14:31:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.983+0000 7fe44ad9d640 1 -- 172.21.15.46:0/626450248 learned_addr learned my addr 172.21.15.46:0/626450248 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:45.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.983+0000 7fe44a59c640 1 --1- 172.21.15.46:0/626450248 >> v1:172.21.15.73:6789/0 conn(0x7fe44c153b00 0x7fe44c0cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50346/0 (socket says 172.21.15.46:50346) 2024-01-27T14:31:45.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.985+0000 7fe44ad9d640 1 -- 172.21.15.46:0/626450248 >> v2:172.21.15.73:3300/0 conn(0x7fe44c0cf2c0 msgr2=0x7fe44c0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:45.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.985+0000 7fe44ad9d640 1 --2- 172.21.15.46:0/626450248 >> v2:172.21.15.73:3300/0 conn(0x7fe44c0cf2c0 0x7fe44c0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:45.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.985+0000 7fe44ad9d640 1 -- 172.21.15.46:0/626450248 >> v1:172.21.15.73:6789/0 conn(0x7fe44c153b00 legacy=0x7fe44c0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:45.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.985+0000 7fe44ad9d640 1 -- 172.21.15.46:0/626450248 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c15d0d0 con 0x7fe44c0ca600 2024-01-27T14:31:45.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.987+0000 7fe44ad9d640 1 --2- 172.21.15.46:0/626450248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0b3730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe444009e50 tx=0x7fe44402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5ee8d4389626dc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:45.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.993+0000 7fe449d9b640 1 -- 172.21.15.46:0/626450248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44402cbb0 con 0x7fe44c0ca600 2024-01-27T14:31:45.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.993+0000 7fe449d9b640 1 -- 172.21.15.46:0/626450248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44402cd10 con 0x7fe44c0ca600 2024-01-27T14:31:45.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.993+0000 7fe449d9b640 1 -- 172.21.15.46:0/626450248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe444034610 con 0x7fe44c0ca600 2024-01-27T14:31:45.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 -- 172.21.15.46:0/626450248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 msgr2=0x7fe44c0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:45.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 --2- 172.21.15.46:0/626450248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0b3730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe444009e50 tx=0x7fe44402c010 comp rx=0 tx=0).stop 2024-01-27T14:31:45.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 -- 172.21.15.46:0/626450248 shutdown_connections 2024-01-27T14:31:45.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 --2- 172.21.15.46:0/626450248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0b3730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:45.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 --2- 172.21.15.46:0/626450248 >> v2:172.21.15.73:3300/0 conn(0x7fe44c0cf2c0 0x7fe44c0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:45.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 -- 172.21.15.46:0/626450248 >> 172.21.15.46:0/626450248 conn(0x7fe44c08b190 msgr2=0x7fe44c08b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:45.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 -- 172.21.15.46:0/626450248 shutdown_connections 2024-01-27T14:31:45.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.994+0000 7fe450a23640 1 -- 172.21.15.46:0/626450248 wait complete. 2024-01-27T14:31:45.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 Processor -- start 2024-01-27T14:31:45.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 -- start start 2024-01-27T14:31:45.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:45.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe44c0cf2c0 0x7fe44c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:45.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe44c153b00 0x7fe44c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c0c62b0 con 0x7fe44c0ca600 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c0c5d50 con 0x7fe44c0cf2c0 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.996+0000 7fe450a23640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1e5aa0 con 0x7fe44c153b00 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.997+0000 7fe44a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.997+0000 7fe443fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe44c0cf2c0 0x7fe44c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.997+0000 7fe44ad9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe44c153b00 0x7fe44c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.997+0000 7fe44a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32880/0 (socket says 172.21.15.46:32880) 2024-01-27T14:31:45.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:45.997+0000 7fe44a59c640 1 -- 172.21.15.46:0/2030588688 learned_addr learned my addr 172.21.15.46:0/2030588688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.001+0000 7fe44a59c640 1 -- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe44c153b00 msgr2=0x7fe44c14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.001+0000 7fe44a59c640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe44c153b00 0x7fe44c14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.001+0000 7fe44a59c640 1 -- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe44c0cf2c0 msgr2=0x7fe44c0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.001+0000 7fe44a59c640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe44c0cf2c0 0x7fe44c0c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.001+0000 7fe44a59c640 1 -- 172.21.15.46:0/2030588688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444009b30 con 0x7fe44c0ca600 2024-01-27T14:31:46.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.003+0000 7fe44a59c640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3c0 tx=0x7fe43c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.007+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0074e0 con 0x7fe44c0ca600 2024-01-27T14:31:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.007+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c007640 con 0x7fe44c0ca600 2024-01-27T14:31:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.007+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c004a00 con 0x7fe44c0ca600 2024-01-27T14:31:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.007+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c1e3710 con 0x7fe44c0ca600 2024-01-27T14:31:46.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.007+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c1e2d30 con 0x7fe44c0ca600 2024-01-27T14:31:46.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.008+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c0742e0 con 0x7fe44c0ca600 2024-01-27T14:31:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.273+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe43c004b60 con 0x7fe44c0ca600 2024-01-27T14:31:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.274+0000 7fe442ffd640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 0x7fe42c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.274+0000 7fe443fff640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 0x7fe42c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.274+0000 7fe443fff640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 0x7fe42c06d3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0c6070 tx=0x7fe434009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:46.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.288+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe43c0582d0 con 0x7fe44c0ca600 2024-01-27T14:31:46.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.289+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe43c0580a0 con 0x7fe44c0ca600 2024-01-27T14:31:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.511+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe44c0cafb0 con 0x7fe44c0ca600 2024-01-27T14:31:46.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.527+0000 7fe442ffd640 1 -- 172.21.15.46:0/2030588688 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5271 (secure 0 0 0) 0x7fe43c057c30 con 0x7fe44c0ca600 2024-01-27T14:31:46.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:46.524 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-27T14:31:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.529+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 msgr2=0x7fe42c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.529+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 0x7fe42c06d3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0c6070 tx=0x7fe434009190 comp rx=0 tx=0).stop 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.529+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 msgr2=0x7fe44c0c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.529+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3c0 tx=0x7fe43c00c880 comp rx=0 tx=0).stop 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 shutdown_connections 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe42c06af20 0x7fe42c06d3e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe44c0cf2c0 0x7fe44c0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe44c153b00 0x7fe44c14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 --2- 172.21.15.46:0/2030588688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe44c0ca600 0x7fe44c0c5190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 >> 172.21.15.46:0/2030588688 conn(0x7fe44c08b190 msgr2=0x7fe44c0b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 shutdown_connections 2024-01-27T14:31:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.530+0000 7fe450a23640 1 -- 172.21.15.46:0/2030588688 wait complete. 2024-01-27T14:31:46.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.641+0000 7f96481b6640 1 Processor -- start 2024-01-27T14:31:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.641+0000 7f96481b6640 1 -- start start 2024-01-27T14:31:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.642+0000 7f96481b6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9640151840 0x7f964006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.642+0000 7f96481b6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9640151c20 con 0x7f964006b350 2024-01-27T14:31:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.642+0000 7f96481b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9640157670 con 0x7f9640157b00 2024-01-27T14:31:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.642+0000 7f96481b6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964015b8e0 con 0x7f9640151840 2024-01-27T14:31:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.643+0000 7f9645f52640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9640151840 0x7f964006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.643+0000 7f9646753640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9640157b00 0x7f9640161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50348/0 (socket says 172.21.15.46:50348) 2024-01-27T14:31:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.643+0000 7f9646753640 1 -- 172.21.15.46:0/4037345994 learned_addr learned my addr 172.21.15.46:0/4037345994 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.645+0000 7f9644f50640 1 -- 172.21.15.46:0/4037345994 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137909633 0 0) 0x7f9640157670 con 0x7f9640157b00 2024-01-27T14:31:46.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.645+0000 7f9644f50640 1 -- 172.21.15.46:0/4037345994 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9628003520 con 0x7f9640157b00 2024-01-27T14:31:46.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.646+0000 7f9645f52640 1 -- 172.21.15.46:0/4037345994 >> v1:172.21.15.73:6789/0 conn(0x7f9640157b00 legacy=0x7f9640161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.646+0000 7f9645f52640 1 -- 172.21.15.46:0/4037345994 >> v1:172.21.15.46:6789/0 conn(0x7f964006b350 legacy=0x7f964006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:46.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.646+0000 7f9645f52640 1 -- 172.21.15.46:0/4037345994 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964015ad60 con 0x7f9640151840 2024-01-27T14:31:46.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.648+0000 7f9645f52640 1 --2- 172.21.15.46:0/4037345994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640151840 0x7f964006ae10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9630009d90 tx=0x7f963002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ab4f1e0503fc1b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:46.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.664+0000 7f9644f50640 1 -- 172.21.15.46:0/4037345994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963002cd00 con 0x7f9640151840 2024-01-27T14:31:46.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.666+0000 7f9644f50640 1 -- 172.21.15.46:0/4037345994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963002ce60 con 0x7f9640151840 2024-01-27T14:31:46.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.666+0000 7f9644f50640 1 -- 172.21.15.46:0/4037345994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630034640 con 0x7f9640151840 2024-01-27T14:31:46.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 -- 172.21.15.46:0/4037345994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640151840 msgr2=0x7f964006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 --2- 172.21.15.46:0/4037345994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640151840 0x7f964006ae10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9630009d90 tx=0x7f963002bf50 comp rx=0 tx=0).stop 2024-01-27T14:31:46.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 -- 172.21.15.46:0/4037345994 shutdown_connections 2024-01-27T14:31:46.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 --2- 172.21.15.46:0/4037345994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640151840 0x7f964006ae10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 -- 172.21.15.46:0/4037345994 >> 172.21.15.46:0/4037345994 conn(0x7f964006fdf0 msgr2=0x7f96400701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:46.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 -- 172.21.15.46:0/4037345994 shutdown_connections 2024-01-27T14:31:46.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.667+0000 7f96481b6640 1 -- 172.21.15.46:0/4037345994 wait complete. 2024-01-27T14:31:46.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.668+0000 7f96481b6640 1 Processor -- start 2024-01-27T14:31:46.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.668+0000 7f96481b6640 1 -- start start 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964006b350 0x7f96400c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9640151840 0x7f9640146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964014e630 con 0x7f9640157b00 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640156000 con 0x7f964006b350 2024-01-27T14:31:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f96481b6640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96401585c0 con 0x7f9640151840 2024-01-27T14:31:46.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.669+0000 7f9646753640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.670+0000 7f9645f52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964006b350 0x7f96400c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.670+0000 7f9646753640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32900/0 (socket says 172.21.15.46:32900) 2024-01-27T14:31:46.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.670+0000 7f9646753640 1 -- 172.21.15.46:0/1211941221 learned_addr learned my addr 172.21.15.46:0/1211941221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:46.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.670+0000 7f9645751640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9640151840 0x7f9640146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.673+0000 7f9646753640 1 -- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9640151840 msgr2=0x7f9640146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.673+0000 7f9646753640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9640151840 0x7f9640146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.673+0000 7f9646753640 1 -- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964006b350 msgr2=0x7f96400c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:46.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.673+0000 7f9646753640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964006b350 0x7f96400c1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:46.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.673+0000 7f9646753640 1 -- 172.21.15.46:0/1211941221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009a70 con 0x7f9640157b00 2024-01-27T14:31:46.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.675+0000 7f9646753640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f963800c3c0 tx=0x7f963800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:46.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.679+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638005ce0 con 0x7f9640157b00 2024-01-27T14:31:46.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.679+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638005e40 con 0x7f9640157b00 2024-01-27T14:31:46.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.679+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638007310 con 0x7f9640157b00 2024-01-27T14:31:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.679+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640158dd0 con 0x7f9640157b00 2024-01-27T14:31:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.679+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9640158af0 con 0x7f9640157b00 2024-01-27T14:31:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.680+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96400742e0 con 0x7f9640157b00 2024-01-27T14:31:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.948+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9638007470 con 0x7f9640157b00 2024-01-27T14:31:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.948+0000 7f963e7fc640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 0x7f962c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:46.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.948+0000 7f9645f52640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 0x7f962c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:46.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.949+0000 7f9645f52640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 0x7f962c06d410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9630036000 tx=0x7f9630030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:46.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.962+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9638057c40 con 0x7f9640157b00 2024-01-27T14:31:46.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:46.962+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9638053f80 con 0x7f9640157b00 2024-01-27T14:31:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.148+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96401481f0 con 0x7f9640157b00 2024-01-27T14:31:47.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.236+0000 7f963e7fc640 1 -- 172.21.15.46:0/1211941221 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12755 (secure 0 0 0) 0x7f9638017090 con 0x7f9640157b00 2024-01-27T14:31:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:47.234 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:32.186931+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 msgr2=0x7f962c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 0x7f962c06d410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9630036000 tx=0x7f9630030000 comp rx=0 tx=0).stop 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 msgr2=0x7f9640159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f963800c3c0 tx=0x7f963800c880 comp rx=0 tx=0).stop 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 shutdown_connections 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f962c06af50 0x7f962c06d410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9640157b00 0x7f9640159300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9640151840 0x7f9640146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 --2- 172.21.15.46:0/1211941221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f964006b350 0x7f96400c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 >> 172.21.15.46:0/1211941221 conn(0x7f964006fdf0 msgr2=0x7f964006de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 shutdown_connections 2024-01-27T14:31:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.239+0000 7f96481b6640 1 -- 172.21.15.46:0/1211941221 wait complete. 2024-01-27T14:31:47.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-27T14:31:47.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:31:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 Processor -- start 2024-01-27T14:31:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 -- start start 2024-01-27T14:31:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40bc153a20 0x7f40bc0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc06bed0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc06cdc0 con 0x7f40bc153a20 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.357+0000 7f40c2e51640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc06c1b0 con 0x7f40bc0cc490 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.358+0000 7f40bbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f40bc15a3c0 0x7f40bc0cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50354/0 (socket says 172.21.15.46:50354) 2024-01-27T14:31:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.358+0000 7f40bbfff640 1 -- 172.21.15.46:0/175602115 learned_addr learned my addr 172.21.15.46:0/175602115 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.360+0000 7f40c13ee640 1 --2- 172.21.15.46:0/175602115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:47.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.362+0000 7f40c13ee640 1 -- 172.21.15.46:0/175602115 >> v2:172.21.15.46:3300/0 conn(0x7f40bc153a20 msgr2=0x7f40bc0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:47.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.362+0000 7f40c13ee640 1 --2- 172.21.15.46:0/175602115 >> v2:172.21.15.46:3300/0 conn(0x7f40bc153a20 0x7f40bc0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.362+0000 7f40c13ee640 1 -- 172.21.15.46:0/175602115 >> v1:172.21.15.73:6789/0 conn(0x7f40bc15a3c0 legacy=0x7f40bc0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.362+0000 7f40c13ee640 1 -- 172.21.15.46:0/175602115 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc06c490 con 0x7f40bc0cc490 2024-01-27T14:31:47.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.366+0000 7f40c13ee640 1 --2- 172.21.15.46:0/175602115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc0ca590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097a0 tx=0x7f40ac02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3928005bff287b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.441+0000 7f40bb7fe640 1 -- 172.21.15.46:0/175602115 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac030610 con 0x7f40bc0cc490 2024-01-27T14:31:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.441+0000 7f40bb7fe640 1 -- 172.21.15.46:0/175602115 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac030770 con 0x7f40bc0cc490 2024-01-27T14:31:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.441+0000 7f40bb7fe640 1 -- 172.21.15.46:0/175602115 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac030b00 con 0x7f40bc0cc490 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 -- 172.21.15.46:0/175602115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 msgr2=0x7f40bc0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 --2- 172.21.15.46:0/175602115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc0ca590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097a0 tx=0x7f40ac02b960 comp rx=0 tx=0).stop 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 -- 172.21.15.46:0/175602115 shutdown_connections 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 --2- 172.21.15.46:0/175602115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc0ca590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 --2- 172.21.15.46:0/175602115 >> v2:172.21.15.46:3300/0 conn(0x7f40bc153a20 0x7f40bc0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 -- 172.21.15.46:0/175602115 >> 172.21.15.46:0/175602115 conn(0x7f40bc071fd0 msgr2=0x7f40bc0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 -- 172.21.15.46:0/175602115 shutdown_connections 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.442+0000 7f40c2e51640 1 -- 172.21.15.46:0/175602115 wait complete. 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.443+0000 7f40c2e51640 1 Processor -- start 2024-01-27T14:31:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.443+0000 7f40c2e51640 1 -- start start 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40bc153a20 0x7f40bc157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 0x7f40bc0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc1586b0 con 0x7f40bc153a20 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc158df0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.444+0000 7f40c2e51640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc14a9a0 con 0x7f40bc0cc490 2024-01-27T14:31:47.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.445+0000 7f40c13ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 0x7f40bc0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:47.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.445+0000 7f40c0bed640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.446+0000 7f40c0bed640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37538/0 (socket says 172.21.15.46:37538) 2024-01-27T14:31:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.446+0000 7f40c0bed640 1 -- 172.21.15.46:0/2371315376 learned_addr learned my addr 172.21.15.46:0/2371315376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.446+0000 7f40bbfff640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40bc153a20 0x7f40bc157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.449+0000 7f40c13ee640 1 -- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 msgr2=0x7f40bc158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.449+0000 7f40c13ee640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.449+0000 7f40c13ee640 1 -- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40bc153a20 msgr2=0x7f40bc157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.449+0000 7f40c13ee640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40bc153a20 0x7f40bc157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.449+0000 7f40c13ee640 1 -- 172.21.15.46:0/2371315376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009400 con 0x7f40bc15a3c0 2024-01-27T14:31:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.456+0000 7f40c13ee640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 0x7f40bc0b1b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ccb30 tx=0x7f40ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.501+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac03e040 con 0x7f40bc15a3c0 2024-01-27T14:31:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.501+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac039c30 con 0x7f40bc15a3c0 2024-01-27T14:31:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.501+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac043440 con 0x7f40bc15a3c0 2024-01-27T14:31:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.501+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc153f80 con 0x7f40bc15a3c0 2024-01-27T14:31:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.501+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc158830 con 0x7f40bc15a3c0 2024-01-27T14:31:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.502+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc0742e0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.743+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f40ac0423e0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.743+0000 7f40b97fa640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 0x7f409c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:47.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.743+0000 7f40c0bed640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 0x7f409c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:47.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.743+0000 7f40c0bed640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 0x7f409c06d3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40b400e250 tx=0x7f40b400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:47.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.748+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40ac07abd0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.759+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f40ac076f10 con 0x7f40bc15a3c0 2024-01-27T14:31:47.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.938+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40bc0b29f0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.943+0000 7f40b97fa640 1 -- 172.21.15.46:0/2371315376 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40ac0480a0 con 0x7f40bc15a3c0 2024-01-27T14:31:47.940 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:31:47.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 msgr2=0x7f409c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 0x7f409c06d3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40b400e250 tx=0x7f40b400b040 comp rx=0 tx=0).stop 2024-01-27T14:31:47.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 msgr2=0x7f40bc0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:47.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 0x7f40bc0b1b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ccb30 tx=0x7f40ac004730 comp rx=0 tx=0).stop 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 shutdown_connections 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f409c06af20 0x7f409c06d3e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40bc15a3c0 0x7f40bc0b1b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40bc153a20 0x7f40bc157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 --2- 172.21.15.46:0/2371315376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40bc0cc490 0x7f40bc158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 >> 172.21.15.46:0/2371315376 conn(0x7f40bc071fd0 msgr2=0x7f40bc1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 shutdown_connections 2024-01-27T14:31:47.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:47.945+0000 7f40c2e51640 1 -- 172.21.15.46:0/2371315376 wait complete. 2024-01-27T14:31:47.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-27T14:31:48.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.056+0000 7fb0b2ca8640 1 Processor -- start 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.056+0000 7fb0b2ca8640 1 -- start start 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.057+0000 7fb0b2ca8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0ac0c9910 0x7fb0ac0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.057+0000 7fb0b2ca8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac0cf7c0 0x7fb0ac15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.057+0000 7fb0b2ca8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac0c4ee0 con 0x7fb0ac153ac0 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.057+0000 7fb0b2ca8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c5230 con 0x7fb0ac0c9910 2024-01-27T14:31:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.057+0000 7fb0b2ca8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c9d50 con 0x7fb0ac0cf7c0 2024-01-27T14:31:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.058+0000 7fb0b0a44640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb0ac153ac0 0x7fb0ac15d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48140/0 (socket says 172.21.15.46:48140) 2024-01-27T14:31:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.058+0000 7fb0b0a44640 1 -- 172.21.15.46:0/2892407016 learned_addr learned my addr 172.21.15.46:0/2892407016 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.058+0000 7fb0abfff640 1 --2- 172.21.15.46:0/2892407016 >> v2:172.21.15.73:3300/0 conn(0x7fb0ac0c9910 0x7fb0ac0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.058+0000 7fb0b1245640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac0cf7c0 0x7fb0ac15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.060+0000 7fb0abfff640 1 -- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac0cf7c0 msgr2=0x7fb0ac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:48.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.060+0000 7fb0abfff640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac0cf7c0 0x7fb0ac15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.060+0000 7fb0abfff640 1 -- 172.21.15.46:0/2892407016 >> v1:172.21.15.46:6789/0 conn(0x7fb0ac153ac0 legacy=0x7fb0ac15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.060+0000 7fb0abfff640 1 -- 172.21.15.46:0/2892407016 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac153ea0 con 0x7fb0ac0c9910 2024-01-27T14:31:48.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.062+0000 7fb0abfff640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac0cf280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2a34d6e93e0a1c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.066+0000 7fb0ab7fe640 1 -- 172.21.15.46:0/2892407016 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c02cce0 con 0x7fb0ac0c9910 2024-01-27T14:31:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.066+0000 7fb0ab7fe640 1 -- 172.21.15.46:0/2892407016 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c02ce40 con 0x7fb0ac0c9910 2024-01-27T14:31:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.066+0000 7fb0ab7fe640 1 -- 172.21.15.46:0/2892407016 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c034660 con 0x7fb0ac0c9910 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.066+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 msgr2=0x7fb0ac0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.066+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac0cf280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bf30 comp rx=0 tx=0).stop 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/2892407016 shutdown_connections 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac0cf7c0 0x7fb0ac15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/2892407016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac0cf280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/2892407016 >> 172.21.15.46:0/2892407016 conn(0x7fb0ac06cca0 msgr2=0x7fb0ac06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/2892407016 shutdown_connections 2024-01-27T14:31:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.067+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/2892407016 wait complete. 2024-01-27T14:31:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.068+0000 7fb0b2ca8640 1 Processor -- start 2024-01-27T14:31:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.068+0000 7fb0b2ca8640 1 -- start start 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.068+0000 7fb0b2ca8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac1f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.068+0000 7fb0b2ca8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 0x7fb0ac0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.068+0000 7fb0b2ca8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac153ac0 0x7fb0ac1ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0b2ca8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1ef230 con 0x7fb0ac0cf7c0 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0b2ca8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac14d390 con 0x7fb0ac0c9910 2024-01-27T14:31:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0b2ca8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1f32a0 con 0x7fb0ac153ac0 2024-01-27T14:31:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 0x7fb0ac0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0b1245640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac153ac0 0x7fb0ac1ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0b0a44640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac1f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 0x7fb0ac0cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32928/0 (socket says 172.21.15.46:32928) 2024-01-27T14:31:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.069+0000 7fb0abfff640 1 -- 172.21.15.46:0/4101210154 learned_addr learned my addr 172.21.15.46:0/4101210154 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.073+0000 7fb0b0a44640 1 -- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac153ac0 msgr2=0x7fb0ac1ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.073+0000 7fb0b0a44640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac153ac0 0x7fb0ac1ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.073+0000 7fb0b0a44640 1 -- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 msgr2=0x7fb0ac0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.073+0000 7fb0b0a44640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 0x7fb0ac0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.073+0000 7fb0b0a44640 1 -- 172.21.15.46:0/4101210154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009a70 con 0x7fb0ac0c9910 2024-01-27T14:31:48.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.075+0000 7fb0b0a44640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac1f2d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000f60 tx=0x7fb0a400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.079+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4005ce0 con 0x7fb0ac0c9910 2024-01-27T14:31:48.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.079+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4005e40 con 0x7fb0ac0c9910 2024-01-27T14:31:48.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.079+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007310 con 0x7fb0ac0c9910 2024-01-27T14:31:48.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.079+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0c8820 con 0x7fb0ac0c9910 2024-01-27T14:31:48.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.079+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac0c8b70 con 0x7fb0ac0c9910 2024-01-27T14:31:48.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.080+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac1ef4a0 con 0x7fb0ac0c9910 2024-01-27T14:31:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.097+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb0a4007470 con 0x7fb0ac0c9910 2024-01-27T14:31:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.097+0000 7fb0a97fa640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 0x7fb08c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.097+0000 7fb0abfff640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 0x7fb08c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.098+0000 7fb0abfff640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 0x7fb08c06d410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f80 tx=0x7fb09c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.099+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0a4001000 con 0x7fb0ac0c9910 2024-01-27T14:31:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.334+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb0a4053e70 con 0x7fb0ac0c9910 2024-01-27T14:31:48.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.520+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0ac0742e0 con 0x7fb0ac0c9910 2024-01-27T14:31:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.527+0000 7fb0a97fa640 1 -- 172.21.15.46:0/4101210154 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb0a4017020 con 0x7fb0ac0c9910 2024-01-27T14:31:48.523 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:48.523 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-01-27T14:31:48.523 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-01-27T14:31:48.524 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-01-27T14:31:48.524 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-01-27T14:31:48.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T14:31:48.524 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 msgr2=0x7fb08c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 0x7fb08c06d410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f80 tx=0x7fb09c030000 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 msgr2=0x7fb0ac1f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac1f2d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000f60 tx=0x7fb0a400c760 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 shutdown_connections 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb08c06af50 0x7fb08c06d410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0ac153ac0 0x7fb0ac1ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0ac0cf7c0 0x7fb0ac0cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 --2- 172.21.15.46:0/4101210154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0ac0c9910 0x7fb0ac1f2d60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 >> 172.21.15.46:0/4101210154 conn(0x7fb0ac06cca0 msgr2=0x7fb0ac14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 shutdown_connections 2024-01-27T14:31:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.528+0000 7fb0b2ca8640 1 -- 172.21.15.46:0/4101210154 wait complete. 2024-01-27T14:31:48.536 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-27T14:31:48.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-27T14:31:48.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.644+0000 7fb18208e640 1 Processor -- start 2024-01-27T14:31:48.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.644+0000 7fb18208e640 1 -- start start 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb17c153a20 0x7fb17c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 0x7fb17c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c06cdc0 con 0x7fb17c0cbd80 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0cc750 con 0x7fb17c153a20 2024-01-27T14:31:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb18208e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c06bed0 con 0x7fb17c15a3c0 2024-01-27T14:31:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb17bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 0x7fb17c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb17b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb17c153a20 0x7fb17c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.645+0000 7fb17affd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.646+0000 7fb17bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 0x7fb17c0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32936/0 (socket says 172.21.15.46:32936) 2024-01-27T14:31:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.646+0000 7fb17bfff640 1 -- 172.21.15.46:0/186400336 learned_addr learned my addr 172.21.15.46:0/186400336 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:48.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.648+0000 7fb17b7fe640 1 -- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 msgr2=0x7fb17c0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:48.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.648+0000 7fb17b7fe640 1 --2- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c0ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.648+0000 7fb17b7fe640 1 -- 172.21.15.46:0/186400336 >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 msgr2=0x7fb17c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:48.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.648+0000 7fb17b7fe640 1 --2- 172.21.15.46:0/186400336 >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 0x7fb17c0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.648+0000 7fb17b7fe640 1 -- 172.21.15.46:0/186400336 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c06c1b0 con 0x7fb17c153a20 2024-01-27T14:31:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.650+0000 7fb17b7fe640 1 --2- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c0ca050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb17c08cb60 tx=0x7fb17002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c991afb7d12daf6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb17a7fc640 1 -- 172.21.15.46:0/186400336 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170031830 con 0x7fb17c153a20 2024-01-27T14:31:48.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb17a7fc640 1 -- 172.21.15.46:0/186400336 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170031990 con 0x7fb17c153a20 2024-01-27T14:31:48.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb17a7fc640 1 -- 172.21.15.46:0/186400336 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170031d20 con 0x7fb17c153a20 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 -- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 msgr2=0x7fb17c0ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 --2- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c0ca050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb17c08cb60 tx=0x7fb17002b8d0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 -- 172.21.15.46:0/186400336 shutdown_connections 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 --2- 172.21.15.46:0/186400336 >> v2:172.21.15.46:3300/0 conn(0x7fb17c0cbd80 0x7fb17c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 --2- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 --2- 172.21.15.46:0/186400336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c0ca050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 -- 172.21.15.46:0/186400336 >> 172.21.15.46:0/186400336 conn(0x7fb17c071fd0 msgr2=0x7fb17c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 -- 172.21.15.46:0/186400336 shutdown_connections 2024-01-27T14:31:48.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.654+0000 7fb18208e640 1 -- 172.21.15.46:0/186400336 wait complete. 2024-01-27T14:31:48.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.655+0000 7fb18208e640 1 Processor -- start 2024-01-27T14:31:48.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 -- start start 2024-01-27T14:31:48.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 0x7fb17c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c1e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c1e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0cd790 con 0x7fb17c0cbd80 2024-01-27T14:31:48.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15a9e0 con 0x7fb17c153a20 2024-01-27T14:31:48.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.656+0000 7fb18208e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c14d980 con 0x7fb17c15a3c0 2024-01-27T14:31:48.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.657+0000 7fb17b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 0x7fb17c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.657+0000 7fb17bfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c1e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.657+0000 7fb17affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c1e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.657+0000 7fb17b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 0x7fb17c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32944/0 (socket says 172.21.15.46:32944) 2024-01-27T14:31:48.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.657+0000 7fb17b7fe640 1 -- 172.21.15.46:0/397149465 learned_addr learned my addr 172.21.15.46:0/397149465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:48.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.660+0000 7fb17bfff640 1 -- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 msgr2=0x7fb17c1e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.660+0000 7fb17bfff640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c1e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.660+0000 7fb17bfff640 1 -- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 msgr2=0x7fb17c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.660+0000 7fb17bfff640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 0x7fb17c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:48.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.660+0000 7fb17bfff640 1 -- 172.21.15.46:0/397149465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009400 con 0x7fb17c15a3c0 2024-01-27T14:31:48.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.663+0000 7fb17bfff640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c1e3450 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb17400eed0 tx=0x7fb17400b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.666+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174010040 con 0x7fb17c15a3c0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.666+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400bd10 con 0x7fb17c15a3c0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.666+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0cda30 con 0x7fb17c15a3c0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.666+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174003bd0 con 0x7fb17c15a3c0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.667+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0cdff0 con 0x7fb17c15a3c0 2024-01-27T14:31:48.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.667+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c1e2c30 con 0x7fb17c15a3c0 2024-01-27T14:31:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.685+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb174003d30 con 0x7fb17c15a3c0 2024-01-27T14:31:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.685+0000 7fb163fff640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 0x7fb16806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:48.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.685+0000 7fb17b7fe640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 0x7fb16806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:48.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.686+0000 7fb17b7fe640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 0x7fb16806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb17002b910 tx=0x7fb17003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.688+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1740584e0 con 0x7fb17c15a3c0 2024-01-27T14:31:48.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:48.919+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb174054820 con 0x7fb17c15a3c0 2024-01-27T14:31:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.102+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb17c1e2c30 con 0x7fb17c15a3c0 2024-01-27T14:31:49.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.690+0000 7fb163fff640 1 -- 172.21.15.46:0/397149465 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb17c1e2c30 con 0x7fb17c15a3c0 2024-01-27T14:31:49.688 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-01-27T14:31:49.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 msgr2=0x7fb16806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:49.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 0x7fb16806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb17002b910 tx=0x7fb17003c040 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 msgr2=0x7fb17c1e3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c1e3450 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb17400eed0 tx=0x7fb17400b480 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 shutdown_connections 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb16806aed0 0x7fb16806d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17c153a20 0x7fb17c1e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb17c15a3c0 0x7fb17c1e3450 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 --2- 172.21.15.46:0/397149465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb17c0cbd80 0x7fb17c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 >> 172.21.15.46:0/397149465 conn(0x7fb17c071fd0 msgr2=0x7fb17c14dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 shutdown_connections 2024-01-27T14:31:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.692+0000 7fb18208e640 1 -- 172.21.15.46:0/397149465 wait complete. 2024-01-27T14:31:49.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-27T14:31:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.811+0000 7f45fb064640 1 Processor -- start 2024-01-27T14:31:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.811+0000 7f45fb064640 1 -- start start 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.811+0000 7f45fb064640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45fb064640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45f40cc2c0 0x7f45f40b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45fb064640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40cc750 con 0x7f45f4153a20 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45fb064640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f406cdc0 con 0x7f45f40cc2c0 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45fb064640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f406bed0 con 0x7f45f415a3c0 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45f9601640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45f40cc2c0 0x7f45f40b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37574/0 (socket says 172.21.15.46:37574) 2024-01-27T14:31:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.812+0000 7f45f3fff640 1 -- 172.21.15.46:0/3812142921 learned_addr learned my addr 172.21.15.46:0/3812142921 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.815+0000 7f45f3fff640 1 -- 172.21.15.46:0/3812142921 >> v2:172.21.15.46:3300/0 conn(0x7f45f40cc2c0 msgr2=0x7f45f40b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.815+0000 7f45f3fff640 1 --2- 172.21.15.46:0/3812142921 >> v2:172.21.15.46:3300/0 conn(0x7f45f40cc2c0 0x7f45f40b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.815+0000 7f45f3fff640 1 -- 172.21.15.46:0/3812142921 >> v1:172.21.15.46:6789/0 conn(0x7f45f4153a20 legacy=0x7f45f40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.815+0000 7f45f3fff640 1 -- 172.21.15.46:0/3812142921 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f406c1b0 con 0x7f45f415a3c0 2024-01-27T14:31:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.816+0000 7f45f3fff640 1 --2- 172.21.15.46:0/3812142921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009870 tx=0x7f45e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=306969626f6692ee server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.820+0000 7f45f37fe640 1 -- 172.21.15.46:0/3812142921 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0030840 con 0x7f45f415a3c0 2024-01-27T14:31:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.820+0000 7f45f37fe640 1 -- 172.21.15.46:0/3812142921 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e00309a0 con 0x7f45f415a3c0 2024-01-27T14:31:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.820+0000 7f45f37fe640 1 -- 172.21.15.46:0/3812142921 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0030d30 con 0x7f45f415a3c0 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 -- 172.21.15.46:0/3812142921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 msgr2=0x7f45f40cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 --2- 172.21.15.46:0/3812142921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009870 tx=0x7f45e002b980 comp rx=0 tx=0).stop 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 -- 172.21.15.46:0/3812142921 shutdown_connections 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 --2- 172.21.15.46:0/3812142921 >> v2:172.21.15.46:3300/0 conn(0x7f45f40cc2c0 0x7f45f40b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 --2- 172.21.15.46:0/3812142921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40cbd80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 -- 172.21.15.46:0/3812142921 >> 172.21.15.46:0/3812142921 conn(0x7f45f4071fd0 msgr2=0x7f45f40723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 -- 172.21.15.46:0/3812142921 shutdown_connections 2024-01-27T14:31:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.821+0000 7f45fb064640 1 -- 172.21.15.46:0/3812142921 wait complete. 2024-01-27T14:31:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.822+0000 7f45fb064640 1 Processor -- start 2024-01-27T14:31:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.822+0000 7f45fb064640 1 -- start start 2024-01-27T14:31:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45f40cc2c0 0x7f45f41593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45f4153a20 0x7f45f414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41e6c30 con 0x7f45f4153a20 2024-01-27T14:31:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c8010 con 0x7f45f40cc2c0 2024-01-27T14:31:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45fb064640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4154c60 con 0x7f45f415a3c0 2024-01-27T14:31:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.823+0000 7f45f9601640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.824+0000 7f45f8e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45f40cc2c0 0x7f45f41593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.824+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45f4153a20 0x7f45f414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.824+0000 7f45f9601640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37588/0 (socket says 172.21.15.46:37588) 2024-01-27T14:31:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.824+0000 7f45f9601640 1 -- 172.21.15.46:0/1096200863 learned_addr learned my addr 172.21.15.46:0/1096200863 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.827+0000 7f45f9601640 1 -- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45f40cc2c0 msgr2=0x7f45f41593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.827+0000 7f45f9601640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45f40cc2c0 0x7f45f41593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.827+0000 7f45f9601640 1 -- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45f4153a20 msgr2=0x7f45f414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.827+0000 7f45f9601640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45f4153a20 0x7f45f414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:49.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.827+0000 7f45f9601640 1 -- 172.21.15.46:0/1096200863 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00094d0 con 0x7f45f415a3c0 2024-01-27T14:31:49.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.829+0000 7f45f9601640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00efc0 tx=0x7f45ec00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.833+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec014480 con 0x7f45f415a3c0 2024-01-27T14:31:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.833+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00f040 con 0x7f45f415a3c0 2024-01-27T14:31:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.833+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec014820 con 0x7f45f415a3c0 2024-01-27T14:31:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.833+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4158050 con 0x7f45f415a3c0 2024-01-27T14:31:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.833+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f4158630 con 0x7f45f415a3c0 2024-01-27T14:31:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.834+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40c81a0 con 0x7f45f415a3c0 2024-01-27T14:31:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.852+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f45ec014980 con 0x7f45f415a3c0 2024-01-27T14:31:49.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.852+0000 7f45f17fa640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 0x7f45d806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:49.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.853+0000 7f45f8e00640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 0x7f45d806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:49.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.853+0000 7f45f8e00640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 0x7f45d806d410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45e8004f60 tx=0x7f45e8007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:49.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:49.855+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f45ec059590 con 0x7f45f415a3c0 2024-01-27T14:31:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.084+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f45ec0558d0 con 0x7f45f415a3c0 2024-01-27T14:31:50.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.264+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f45f40742e0 con 0x7f45f415a3c0 2024-01-27T14:31:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.808+0000 7f45f17fa640 1 -- 172.21.15.46:0/1096200863 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f45ec018020 con 0x7f45f415a3c0 2024-01-27T14:31:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 msgr2=0x7f45d806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 0x7f45d806d410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45e8004f60 tx=0x7f45e8007e30 comp rx=0 tx=0).stop 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 msgr2=0x7f45f40c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00efc0 tx=0x7f45ec00c490 comp rx=0 tx=0).stop 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 shutdown_connections 2024-01-27T14:31:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f45d806af50 0x7f45d806d410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45f415a3c0 0x7f45f40c84a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45f4153a20 0x7f45f414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 --2- 172.21.15.46:0/1096200863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45f40cc2c0 0x7f45f41593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.810+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 >> 172.21.15.46:0/1096200863 conn(0x7f45f4071fd0 msgr2=0x7f45f40c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.811+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 shutdown_connections 2024-01-27T14:31:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.811+0000 7f45fb064640 1 -- 172.21.15.46:0/1096200863 wait complete. 2024-01-27T14:31:50.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-27T14:31:50.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.931+0000 7f60ef397640 1 Processor -- start 2024-01-27T14:31:50.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.931+0000 7f60ef397640 1 -- start start 2024-01-27T14:31:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ef397640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60e8153a20 0x7f60e80ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ef397640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ef397640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e806bed0 con 0x7f60e80cbd80 2024-01-27T14:31:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ef397640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e806cdc0 con 0x7f60e8153a20 2024-01-27T14:31:50.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ef397640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e806c1b0 con 0x7f60e815a3c0 2024-01-27T14:31:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.932+0000 7f60ec932640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.933+0000 7f60ec932640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37598/0 (socket says 172.21.15.46:37598) 2024-01-27T14:31:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.933+0000 7f60ec932640 1 -- 172.21.15.46:0/630909660 learned_addr learned my addr 172.21.15.46:0/630909660 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.935+0000 7f60ec932640 1 -- 172.21.15.46:0/630909660 >> v2:172.21.15.73:3300/0 conn(0x7f60e8153a20 msgr2=0x7f60e80ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.935+0000 7f60ec932640 1 --2- 172.21.15.46:0/630909660 >> v2:172.21.15.73:3300/0 conn(0x7f60e8153a20 0x7f60e80ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.935+0000 7f60ec932640 1 -- 172.21.15.46:0/630909660 >> v1:172.21.15.73:6789/0 conn(0x7f60e80cbd80 legacy=0x7f60e80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:50.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.935+0000 7f60ec932640 1 -- 172.21.15.46:0/630909660 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e806c490 con 0x7f60e815a3c0 2024-01-27T14:31:50.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.937+0000 7f60ec932640 1 --2- 172.21.15.46:0/630909660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009870 tx=0x7f60d802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82e7a52660a4d0d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.940+0000 7f60dffff640 1 -- 172.21.15.46:0/630909660 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8030840 con 0x7f60e815a3c0 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.940+0000 7f60dffff640 1 -- 172.21.15.46:0/630909660 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80309a0 con 0x7f60e815a3c0 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.940+0000 7f60dffff640 1 -- 172.21.15.46:0/630909660 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8030d30 con 0x7f60e815a3c0 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 -- 172.21.15.46:0/630909660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 msgr2=0x7f60e80ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 --2- 172.21.15.46:0/630909660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009870 tx=0x7f60d802b980 comp rx=0 tx=0).stop 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 -- 172.21.15.46:0/630909660 shutdown_connections 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 --2- 172.21.15.46:0/630909660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e80ca590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 --2- 172.21.15.46:0/630909660 >> v2:172.21.15.73:3300/0 conn(0x7f60e8153a20 0x7f60e80ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 -- 172.21.15.46:0/630909660 >> 172.21.15.46:0/630909660 conn(0x7f60e8071fd0 msgr2=0x7f60e80723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 -- 172.21.15.46:0/630909660 shutdown_connections 2024-01-27T14:31:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.941+0000 7f60ef397640 1 -- 172.21.15.46:0/630909660 wait complete. 2024-01-27T14:31:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.942+0000 7f60ef397640 1 Processor -- start 2024-01-27T14:31:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.942+0000 7f60ef397640 1 -- start start 2024-01-27T14:31:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e80cbd80 0x7f60e814b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8153a20 0x7f60e815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e814d440 con 0x7f60e8153a20 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e814c0c0 con 0x7f60e80cbd80 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ef397640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e814c3a0 con 0x7f60e815a3c0 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ec932640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8153a20 0x7f60e815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.943+0000 7f60ed934640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.944+0000 7f60ed934640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37610/0 (socket says 172.21.15.46:37610) 2024-01-27T14:31:50.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.944+0000 7f60ed934640 1 -- 172.21.15.46:0/1156300197 learned_addr learned my addr 172.21.15.46:0/1156300197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.947+0000 7f60ed934640 1 -- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e80cbd80 msgr2=0x7f60e814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.947+0000 7f60ed934640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e80cbd80 0x7f60e814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.947+0000 7f60ed934640 1 -- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8153a20 msgr2=0x7f60e815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:50.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.947+0000 7f60ed934640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8153a20 0x7f60e815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:50.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.947+0000 7f60ed934640 1 -- 172.21.15.46:0/1156300197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80094d0 con 0x7f60e815a3c0 2024-01-27T14:31:50.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.949+0000 7f60ed934640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c780 tx=0x7f60e000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:50.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.953+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0003d80 con 0x7f60e815a3c0 2024-01-27T14:31:50.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.953+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000ce90 con 0x7f60e815a3c0 2024-01-27T14:31:50.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.953+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00052b0 con 0x7f60e815a3c0 2024-01-27T14:31:50.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.953+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8153f80 con 0x7f60e815a3c0 2024-01-27T14:31:50.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.953+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e814c960 con 0x7f60e815a3c0 2024-01-27T14:31:50.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.954+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e80742e0 con 0x7f60e815a3c0 2024-01-27T14:31:50.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.974+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f60e0005410 con 0x7f60e815a3c0 2024-01-27T14:31:50.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.974+0000 7f60ddffb640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 0x7f60cc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:50.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.974+0000 7f60ed133640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 0x7f60cc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:50.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.975+0000 7f60ed133640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 0x7f60cc06d410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009710 tx=0x7f60e4006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:50.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:50.977+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f60e0057e90 con 0x7f60e815a3c0 2024-01-27T14:31:51.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:51.213+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f60e00541d0 con 0x7f60e815a3c0 2024-01-27T14:31:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:51.432+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f60e80ca880 con 0x7f60e815a3c0 2024-01-27T14:31:52.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.557+0000 7f60ddffb640 1 -- 172.21.15.46:0/1156300197 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f60e00577f0 con 0x7f60e815a3c0 2024-01-27T14:31:52.554 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 msgr2=0x7f60cc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 0x7f60cc06d410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009710 tx=0x7f60e4006c90 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 msgr2=0x7f60e815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c780 tx=0x7f60e000cc40 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 shutdown_connections 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60cc06af50 0x7f60cc06d410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60e815a3c0 0x7f60e815d250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8153a20 0x7f60e815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 --2- 172.21.15.46:0/1156300197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e80cbd80 0x7f60e814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 >> 172.21.15.46:0/1156300197 conn(0x7f60e8071fd0 msgr2=0x7f60e8150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 shutdown_connections 2024-01-27T14:31:52.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.559+0000 7f60ef397640 1 -- 172.21.15.46:0/1156300197 wait complete. 2024-01-27T14:31:52.567 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-27T14:31:52.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-27T14:31:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.676+0000 7f625759b640 1 Processor -- start 2024-01-27T14:31:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.676+0000 7f625759b640 1 -- start start 2024-01-27T14:31:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f625759b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62500714d0 0x7f625015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f625759b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f625015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f625759b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62500c7ba0 con 0x7f62500710f0 2024-01-27T14:31:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f625759b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6250159a60 con 0x7f62500714d0 2024-01-27T14:31:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f625759b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6250159d40 con 0x7f62500c93b0 2024-01-27T14:31:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f6255337640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f62500710f0 0x7f62500ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48158/0 (socket says 172.21.15.46:48158) 2024-01-27T14:31:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f6255337640 1 -- 172.21.15.46:0/1515650579 learned_addr learned my addr 172.21.15.46:0/1515650579 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f6255b38640 1 --2- 172.21.15.46:0/1515650579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f625015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.677+0000 7f6254b36640 1 --2- 172.21.15.46:0/1515650579 >> v2:172.21.15.73:3300/0 conn(0x7f62500714d0 0x7f625015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:52.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.680+0000 7f6255b38640 1 -- 172.21.15.46:0/1515650579 >> v2:172.21.15.73:3300/0 conn(0x7f62500714d0 msgr2=0x7f625015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:52.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.680+0000 7f6255b38640 1 --2- 172.21.15.46:0/1515650579 >> v2:172.21.15.73:3300/0 conn(0x7f62500714d0 0x7f625015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.680+0000 7f6255b38640 1 -- 172.21.15.46:0/1515650579 >> v1:172.21.15.46:6789/0 conn(0x7f62500710f0 legacy=0x7f62500ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.680+0000 7f6255b38640 1 -- 172.21.15.46:0/1515650579 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625015a020 con 0x7f62500c93b0 2024-01-27T14:31:52.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.680+0000 7f6247fff640 1 -- 172.21.15.46:0/1515650579 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872116168 0 0) 0x7f62500c7ba0 con 0x7f62500710f0 2024-01-27T14:31:52.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.682+0000 7f6255b38640 1 --2- 172.21.15.46:0/1515650579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f625015d800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6248009d90 tx=0x7f624802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e55639bd6a7c2502 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f6247fff640 1 -- 172.21.15.46:0/1515650579 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624802cce0 con 0x7f62500c93b0 2024-01-27T14:31:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f6247fff640 1 -- 172.21.15.46:0/1515650579 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624802ce40 con 0x7f62500c93b0 2024-01-27T14:31:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f6247fff640 1 -- 172.21.15.46:0/1515650579 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248034660 con 0x7f62500c93b0 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 -- 172.21.15.46:0/1515650579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 msgr2=0x7f625015d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 --2- 172.21.15.46:0/1515650579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f625015d800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6248009d90 tx=0x7f624802bf30 comp rx=0 tx=0).stop 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 -- 172.21.15.46:0/1515650579 shutdown_connections 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 --2- 172.21.15.46:0/1515650579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f625015d800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 --2- 172.21.15.46:0/1515650579 >> v2:172.21.15.73:3300/0 conn(0x7f62500714d0 0x7f625015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 -- 172.21.15.46:0/1515650579 >> 172.21.15.46:0/1515650579 conn(0x7f6250066ac0 msgr2=0x7f625006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 -- 172.21.15.46:0/1515650579 shutdown_connections 2024-01-27T14:31:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.686+0000 7f625759b640 1 -- 172.21.15.46:0/1515650579 wait complete. 2024-01-27T14:31:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 Processor -- start 2024-01-27T14:31:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 -- start start 2024-01-27T14:31:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62500710f0 0x7f62501ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62500714d0 0x7f62500cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625015a8b0 con 0x7f62500714d0 2024-01-27T14:31:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625014d6f0 con 0x7f62500710f0 2024-01-27T14:31:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.688+0000 7f625759b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625014d940 con 0x7f62500c93b0 2024-01-27T14:31:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.689+0000 7f6255b38640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.689+0000 7f6255337640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62500710f0 0x7f62501ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.689+0000 7f6255b38640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:37634/0 (socket says 172.21.15.46:37634) 2024-01-27T14:31:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.689+0000 7f6255b38640 1 -- 172.21.15.46:0/3369773400 learned_addr learned my addr 172.21.15.46:0/3369773400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:52.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.692+0000 7f6255b38640 1 -- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62500710f0 msgr2=0x7f62501ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.692+0000 7f6255b38640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62500710f0 0x7f62501ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.692+0000 7f6255b38640 1 -- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62500714d0 msgr2=0x7f62500cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.692+0000 7f6255b38640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62500714d0 0x7f62500cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.692+0000 7f6255b38640 1 -- 172.21.15.46:0/3369773400 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248009a70 con 0x7f62500c93b0 2024-01-27T14:31:52.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.694+0000 7f6255b38640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6248009d90 tx=0x7f6248004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.698+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624803d600 con 0x7f62500c93b0 2024-01-27T14:31:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.698+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624803d760 con 0x7f62500c93b0 2024-01-27T14:31:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.698+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624803db10 con 0x7f62500c93b0 2024-01-27T14:31:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.698+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625014dc20 con 0x7f62500c93b0 2024-01-27T14:31:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.699+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62500cc190 con 0x7f62500c93b0 2024-01-27T14:31:52.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.700+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62500742e0 con 0x7f62500c93b0 2024-01-27T14:31:52.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.944+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f624803b040 con 0x7f62500c93b0 2024-01-27T14:31:52.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.945+0000 7f6245ffb640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 0x7f623406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:52.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.945+0000 7f6255337640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 0x7f623406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:52.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.945+0000 7f6255337640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 0x7f623406d3e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f624c000f60 tx=0x7f624c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.949+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f624807a9a0 con 0x7f62500c93b0 2024-01-27T14:31:52.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:52.961+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6248076ce0 con 0x7f62500c93b0 2024-01-27T14:31:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:53.169+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6250157190 con 0x7f62500c93b0 2024-01-27T14:31:54.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.292+0000 7f6245ffb640 1 -- 172.21.15.46:0/3369773400 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f62480390e0 con 0x7f62500c93b0 2024-01-27T14:31:54.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 msgr2=0x7f623406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 0x7f623406d3e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f624c000f60 tx=0x7f624c007d50 comp rx=0 tx=0).stop 2024-01-27T14:31:54.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 msgr2=0x7f62500cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6248009d90 tx=0x7f6248004a40 comp rx=0 tx=0).stop 2024-01-27T14:31:54.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 shutdown_connections 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f623406af20 0x7f623406d3e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62500c93b0 0x7f62500cc990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62500714d0 0x7f62500cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 --2- 172.21.15.46:0/3369773400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62500710f0 0x7f62501ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 >> 172.21.15.46:0/3369773400 conn(0x7f6250066ac0 msgr2=0x7f6250073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 shutdown_connections 2024-01-27T14:31:54.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.295+0000 7f625759b640 1 -- 172.21.15.46:0/3369773400 wait complete. 2024-01-27T14:31:54.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-27T14:31:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 Processor -- start 2024-01-27T14:31:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 -- start start 2024-01-27T14:31:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 0x7f7fcc15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7fcc08b670 0x7f7fcc1641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0ca820 con 0x7f7fcc0cbdf0 2024-01-27T14:31:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0ca3d0 con 0x7f7fcc08b670 2024-01-27T14:31:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.417+0000 7f7fd20ee640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0c9e10 con 0x7f7fcc153b60 2024-01-27T14:31:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.418+0000 7f7fcbfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7fcc08b670 0x7f7fcc1641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.418+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 0x7f7fcc15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.418+0000 7f7fcaffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7fcc0cbdf0 0x7f7fcc08af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50372/0 (socket says 172.21.15.46:50372) 2024-01-27T14:31:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.418+0000 7f7fcaffd640 1 -- 172.21.15.46:0/2029859001 learned_addr learned my addr 172.21.15.46:0/2029859001 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fca7fc640 1 -- 172.21.15.46:0/2029859001 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267835932 0 0) 0x7f7fcc0ca820 con 0x7f7fcc0cbdf0 2024-01-27T14:31:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fca7fc640 1 -- 172.21.15.46:0/2029859001 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb4003520 con 0x7f7fcc0cbdf0 2024-01-27T14:31:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fcbfff640 1 -- 172.21.15.46:0/2029859001 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 msgr2=0x7f7fcc15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fcbfff640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 0x7f7fcc15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fcbfff640 1 -- 172.21.15.46:0/2029859001 >> v1:172.21.15.73:6789/0 conn(0x7f7fcc0cbdf0 legacy=0x7f7fcc08af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fcbfff640 1 -- 172.21.15.46:0/2029859001 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0ca0f0 con 0x7f7fcc08b670 2024-01-27T14:31:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.421+0000 7f7fcb7fe640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 0x7f7fcc15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:31:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.423+0000 7f7fcbfff640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc1641c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009d90 tx=0x7f7fc402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0644bd2efdea36 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fca7fc640 1 -- 172.21.15.46:0/2029859001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc402cc50 con 0x7f7fcc08b670 2024-01-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fca7fc640 1 -- 172.21.15.46:0/2029859001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc402cdb0 con 0x7f7fcc08b670 2024-01-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fca7fc640 1 -- 172.21.15.46:0/2029859001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4034660 con 0x7f7fcc08b670 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 -- 172.21.15.46:0/2029859001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 msgr2=0x7f7fcc1641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc1641c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009d90 tx=0x7f7fc402bea0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 -- 172.21.15.46:0/2029859001 shutdown_connections 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc1641c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/2029859001 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc153b60 0x7f7fcc15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 -- 172.21.15.46:0/2029859001 >> 172.21.15.46:0/2029859001 conn(0x7f7fcc071df0 msgr2=0x7f7fcc072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 -- 172.21.15.46:0/2029859001 shutdown_connections 2024-01-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.427+0000 7f7fd20ee640 1 -- 172.21.15.46:0/2029859001 wait complete. 2024-01-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.429+0000 7f7fd20ee640 1 Processor -- start 2024-01-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.429+0000 7f7fd20ee640 1 -- start start 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc0cbdf0 0x7f7fcc156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc153b60 0x7f7fcc1f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1587f0 con 0x7f7fcc08b670 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1564d0 con 0x7f7fcc153b60 2024-01-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fd20ee640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc155ef0 con 0x7f7fcc0cbdf0 2024-01-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc153b60 0x7f7fcc1f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fcaffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc0cbdf0 0x7f7fcc156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33006/0 (socket says 172.21.15.46:33006) 2024-01-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.430+0000 7f7fcb7fe640 1 -- 172.21.15.46:0/1895409375 learned_addr learned my addr 172.21.15.46:0/1895409375 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.434+0000 7f7fcb7fe640 1 -- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc0cbdf0 msgr2=0x7f7fcc156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.434+0000 7f7fcb7fe640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc0cbdf0 0x7f7fcc156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.434+0000 7f7fcb7fe640 1 -- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc153b60 msgr2=0x7f7fcc1f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.434+0000 7f7fcb7fe640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc153b60 0x7f7fcc1f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.434+0000 7f7fcb7fe640 1 -- 172.21.15.46:0/1895409375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009400 con 0x7f7fcc08b670 2024-01-27T14:31:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.436+0000 7f7fcb7fe640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00e990 tx=0x7f7fbc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.440+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00c9e0 con 0x7f7fcc08b670 2024-01-27T14:31:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.440+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00cb40 con 0x7f7fcc08b670 2024-01-27T14:31:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.440+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4009a70 con 0x7f7fcc08b670 2024-01-27T14:31:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.440+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00ced0 con 0x7f7fcc08b670 2024-01-27T14:31:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.440+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc1effe0 con 0x7f7fcc08b670 2024-01-27T14:31:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.441+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0742e0 con 0x7f7fcc08b670 2024-01-27T14:31:54.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.708+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7fbc013470 con 0x7f7fcc08b670 2024-01-27T14:31:54.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.708+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 0x7f7fb806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:54.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.708+0000 7f7fcaffd640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 0x7f7fb806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:54.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.709+0000 7f7fcaffd640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 0x7f7fb806d3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc154bc0 tx=0x7f7fc0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.722+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7fbc058c30 con 0x7f7fcc08b670 2024-01-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.722+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7fbc054f70 con 0x7f7fcc08b670 2024-01-27T14:31:54.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:54.903+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7fcc0c5cd0 con 0x7f7fcc08b670 2024-01-27T14:31:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.495+0000 7f7fb3fff640 1 -- 172.21.15.46:0/1895409375 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7fbc021100 con 0x7f7fcc08b670 2024-01-27T14:31:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' created 2024-01-27T14:31:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 msgr2=0x7f7fb806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 0x7f7fb806d3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc154bc0 tx=0x7f7fc0009040 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 msgr2=0x7f7fcc156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00e990 tx=0x7f7fbc00ee50 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 shutdown_connections 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7fb806af20 0x7f7fb806d3e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc153b60 0x7f7fcc1f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fcc0cbdf0 0x7f7fcc156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 --2- 172.21.15.46:0/1895409375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fcc08b670 0x7f7fcc156960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 >> 172.21.15.46:0/1895409375 conn(0x7f7fcc071df0 msgr2=0x7f7fcc0c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 shutdown_connections 2024-01-27T14:31:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.498+0000 7f7fd20ee640 1 -- 172.21.15.46:0/1895409375 wait complete. 2024-01-27T14:31:56.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-27T14:31:56.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.630+0000 7f6c4e594640 1 Processor -- start 2024-01-27T14:31:56.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.630+0000 7f6c4e594640 1 -- start start 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.631+0000 7f6c4e594640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c48153b60 0x7f6c4815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.631+0000 7f6c4e594640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c481641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.631+0000 7f6c4e594640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480ca820 con 0x7f6c480cbdf0 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.631+0000 7f6c4e594640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480ca3d0 con 0x7f6c48153b60 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.631+0000 7f6c4e594640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480c9e10 con 0x7f6c4808b670 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.632+0000 7f6c47fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6c48153b60 0x7f6c4815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.632+0000 7f6c4cb31640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c481641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.632+0000 7f6c477fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6c480cbdf0 0x7f6c4808af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50068/0 (socket says 172.21.15.46:50068) 2024-01-27T14:31:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.632+0000 7f6c477fe640 1 -- 172.21.15.46:0/2603129831 learned_addr learned my addr 172.21.15.46:0/2603129831 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c46ffd640 1 -- 172.21.15.46:0/2603129831 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902286402 0 0) 0x7f6c480ca820 con 0x7f6c480cbdf0 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c46ffd640 1 -- 172.21.15.46:0/2603129831 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c30003520 con 0x7f6c480cbdf0 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c4cb31640 1 -- 172.21.15.46:0/2603129831 >> v2:172.21.15.46:3300/0 conn(0x7f6c48153b60 msgr2=0x7f6c4815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c4cb31640 1 --2- 172.21.15.46:0/2603129831 >> v2:172.21.15.46:3300/0 conn(0x7f6c48153b60 0x7f6c4815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c4cb31640 1 -- 172.21.15.46:0/2603129831 >> v1:172.21.15.73:6789/0 conn(0x7f6c480cbdf0 legacy=0x7f6c4808af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.634+0000 7f6c4cb31640 1 -- 172.21.15.46:0/2603129831 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480ca0f0 con 0x7f6c4808b670 2024-01-27T14:31:56.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.636+0000 7f6c4cb31640 1 --2- 172.21.15.46:0/2603129831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c481641c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c4002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3366a0bc5feba403 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:56.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.640+0000 7f6c46ffd640 1 -- 172.21.15.46:0/2603129831 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4002cc50 con 0x7f6c4808b670 2024-01-27T14:31:56.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.640+0000 7f6c46ffd640 1 -- 172.21.15.46:0/2603129831 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4002cdb0 con 0x7f6c4808b670 2024-01-27T14:31:56.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.640+0000 7f6c46ffd640 1 -- 172.21.15.46:0/2603129831 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40034660 con 0x7f6c4808b670 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 -- 172.21.15.46:0/2603129831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 msgr2=0x7f6c481641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2603129831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c481641c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c4002bea0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 -- 172.21.15.46:0/2603129831 shutdown_connections 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2603129831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c481641c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2603129831 >> v2:172.21.15.46:3300/0 conn(0x7f6c48153b60 0x7f6c4815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 -- 172.21.15.46:0/2603129831 >> 172.21.15.46:0/2603129831 conn(0x7f6c48071df0 msgr2=0x7f6c48072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 -- 172.21.15.46:0/2603129831 shutdown_connections 2024-01-27T14:31:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.641+0000 7f6c4e594640 1 -- 172.21.15.46:0/2603129831 wait complete. 2024-01-27T14:31:56.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.642+0000 7f6c4e594640 1 Processor -- start 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.642+0000 7f6c4e594640 1 -- start start 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c480c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c48153b60 0x7f6c481eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481f2480 con 0x7f6c480cbdf0 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481f3430 con 0x7f6c48153b60 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.643+0000 7f6c4e594640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481f2fa0 con 0x7f6c4808b670 2024-01-27T14:31:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.644+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.644+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c480c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.644+0000 7f6c4cb31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c48153b60 0x7f6c481eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.644+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37778/0 (socket says 172.21.15.46:37778) 2024-01-27T14:31:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.644+0000 7f6c477fe640 1 -- 172.21.15.46:0/2961423206 learned_addr learned my addr 172.21.15.46:0/2961423206 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.647+0000 7f6c477fe640 1 -- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 msgr2=0x7f6c480c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.647+0000 7f6c477fe640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c480c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.647+0000 7f6c477fe640 1 -- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c48153b60 msgr2=0x7f6c481eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.647+0000 7f6c477fe640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c48153b60 0x7f6c481eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.647+0000 7f6c477fe640 1 -- 172.21.15.46:0/2961423206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009a70 con 0x7f6c480cbdf0 2024-01-27T14:31:56.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.650+0000 7f6c477fe640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c4d0 tx=0x7f6c3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.653+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c005ce0 con 0x7f6c480cbdf0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.654+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c005e60 con 0x7f6c480cbdf0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.654+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0072b0 con 0x7f6c480cbdf0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.654+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c480c5ac0 con 0x7f6c480cbdf0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.654+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c481f2950 con 0x7f6c480cbdf0 2024-01-27T14:31:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.654+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c481f3110 con 0x7f6c480cbdf0 2024-01-27T14:31:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.674+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6c3c007410 con 0x7f6c480cbdf0 2024-01-27T14:31:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.675+0000 7f6c44ff9640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 0x7f6c3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.675+0000 7f6c47fff640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 0x7f6c3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.675+0000 7f6c47fff640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 0x7f6c3406d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009b40 tx=0x7f6c38009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:56.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.936+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6c3c057c60 con 0x7f6c480cbdf0 2024-01-27T14:31:56.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:56.936+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6c3c053fa0 con 0x7f6c480cbdf0 2024-01-27T14:31:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.117+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f6c480742e0 con 0x7f6c480cbdf0 2024-01-27T14:31:57.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:31:57.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:31:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.640+0000 7f6c44ff9640 1 -- 172.21.15.46:0/2961423206 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6c3c0170c0 con 0x7f6c480cbdf0 2024-01-27T14:31:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:set pool 4 allow_ec_overwrites to true 2024-01-27T14:31:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 msgr2=0x7f6c3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 0x7f6c3406d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009b40 tx=0x7f6c38009190 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 msgr2=0x7f6c480c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c4d0 tx=0x7f6c3c00c990 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 shutdown_connections 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6c3406af00 0x7f6c3406d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c48153b60 0x7f6c481eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c480cbdf0 0x7f6c480c7130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 --2- 172.21.15.46:0/2961423206 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c4808b670 0x7f6c480c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 >> 172.21.15.46:0/2961423206 conn(0x7f6c48071df0 msgr2=0x7f6c48151c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 shutdown_connections 2024-01-27T14:31:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.642+0000 7f6c4e594640 1 -- 172.21.15.46:0/2961423206 wait complete. 2024-01-27T14:31:57.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-27T14:31:57.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.773+0000 7f0285dec640 1 Processor -- start 2024-01-27T14:31:57.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.773+0000 7f0285dec640 1 -- start start 2024-01-27T14:31:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.774+0000 7f0285dec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028015a3a0 0x7f028008af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.774+0000 7f0285dec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f028008b4a0 0x7f028008b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.774+0000 7f0285dec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02800ca820 con 0x7f0280153b60 2024-01-27T14:31:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.774+0000 7f0285dec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028015a7c0 con 0x7f028008b4a0 2024-01-27T14:31:57.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.774+0000 7f0285dec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02800ca3d0 con 0x7f028015a3a0 2024-01-27T14:31:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.787+0000 7f027effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028015a3a0 0x7f028008af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.787+0000 7f027effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028015a3a0 0x7f028008af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47214/0 (socket says 172.21.15.46:47214) 2024-01-27T14:31:57.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.787+0000 7f027effd640 1 -- 172.21.15.46:0/4070752455 learned_addr learned my addr 172.21.15.46:0/4070752455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.791+0000 7f027effd640 1 -- 172.21.15.46:0/4070752455 >> v2:172.21.15.46:3300/0 conn(0x7f028008b4a0 msgr2=0x7f028008b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.791+0000 7f027effd640 1 --2- 172.21.15.46:0/4070752455 >> v2:172.21.15.46:3300/0 conn(0x7f028008b4a0 0x7f028008b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.791+0000 7f027effd640 1 -- 172.21.15.46:0/4070752455 >> v1:172.21.15.73:6789/0 conn(0x7f0280153b60 legacy=0x7f02800cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.791+0000 7f027effd640 1 -- 172.21.15.46:0/4070752455 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800c9e10 con 0x7f028015a3a0 2024-01-27T14:31:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.796+0000 7f027effd640 1 --2- 172.21.15.46:0/4070752455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028008af60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02800ccb30 tx=0x7f027402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594d1b06451f8594 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.799+0000 7f027e7fc640 1 -- 172.21.15.46:0/4070752455 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274030860 con 0x7f028015a3a0 2024-01-27T14:31:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.799+0000 7f027e7fc640 1 -- 172.21.15.46:0/4070752455 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740309c0 con 0x7f028015a3a0 2024-01-27T14:31:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.799+0000 7f027e7fc640 1 -- 172.21.15.46:0/4070752455 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274030d50 con 0x7f028015a3a0 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 -- 172.21.15.46:0/4070752455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 msgr2=0x7f028008af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 --2- 172.21.15.46:0/4070752455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028008af60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02800ccb30 tx=0x7f027402b9a0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 -- 172.21.15.46:0/4070752455 shutdown_connections 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 --2- 172.21.15.46:0/4070752455 >> v2:172.21.15.46:3300/0 conn(0x7f028008b4a0 0x7f028008b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 --2- 172.21.15.46:0/4070752455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028008af60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 -- 172.21.15.46:0/4070752455 >> 172.21.15.46:0/4070752455 conn(0x7f0280071df0 msgr2=0x7f0280072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 -- 172.21.15.46:0/4070752455 shutdown_connections 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.800+0000 7f0285dec640 1 -- 172.21.15.46:0/4070752455 wait complete. 2024-01-27T14:31:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.801+0000 7f0285dec640 1 Processor -- start 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.801+0000 7f0285dec640 1 -- start start 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 0x7f028014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0280153b60 0x7f028014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801f2a60 con 0x7f0280153b60 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028014f190 con 0x7f028015a3a0 2024-01-27T14:31:57.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.802+0000 7f0285dec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02801f2cb0 con 0x7f028008b4a0 2024-01-27T14:31:57.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.803+0000 7f027ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:57.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.803+0000 7f027f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 0x7f028014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:57.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.803+0000 7f027ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47230/0 (socket says 172.21.15.46:47230) 2024-01-27T14:31:57.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.803+0000 7f027ffff640 1 -- 172.21.15.46:0/626324179 learned_addr learned my addr 172.21.15.46:0/626324179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027ffff640 1 -- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 msgr2=0x7f028014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027ffff640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 0x7f028014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027ffff640 1 -- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0280153b60 msgr2=0x7f028014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027ffff640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0280153b60 0x7f028014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027ffff640 1 -- 172.21.15.46:0/626324179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094d0 con 0x7f028015a3a0 2024-01-27T14:31:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.806+0000 7f027f7fe640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 0x7f028014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:31:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.808+0000 7f027ffff640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f027800b970 tx=0x7f027800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.812+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800cb40 con 0x7f028015a3a0 2024-01-27T14:31:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.812+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800ccc0 con 0x7f028015a3a0 2024-01-27T14:31:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.812+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801f2f90 con 0x7f028015a3a0 2024-01-27T14:31:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.812+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278014680 con 0x7f028015a3a0 2024-01-27T14:31:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.812+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801f3550 con 0x7f028015a3a0 2024-01-27T14:31:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.813+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02801f3740 con 0x7f028015a3a0 2024-01-27T14:31:57.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.831+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f027801d3b0 con 0x7f028015a3a0 2024-01-27T14:31:57.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.832+0000 7f0267fff640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 0x7f026c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:57.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.832+0000 7f027f7fe640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 0x7f026c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:57.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.832+0000 7f027f7fe640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 0x7f026c06d410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:57.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:57.833+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f027800ce30 con 0x7f028015a3a0 2024-01-27T14:31:58.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.076+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f02780548b0 con 0x7f028015a3a0 2024-01-27T14:31:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.296+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f02800742e0 con 0x7f028015a3a0 2024-01-27T14:31:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.848+0000 7f0267fff640 1 -- 172.21.15.46:0/626324179 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0278019020 con 0x7f028015a3a0 2024-01-27T14:31:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:added data pool 4 to fsmap 2024-01-27T14:31:58.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 msgr2=0x7f026c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 0x7f026c06d410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 msgr2=0x7f028014ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f027800b970 tx=0x7f027800be30 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 shutdown_connections 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f026c06af50 0x7f026c06d410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028015a3a0 0x7f028014ebb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0280153b60 0x7f028014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 --2- 172.21.15.46:0/626324179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f028008b4a0 0x7f028014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 >> 172.21.15.46:0/626324179 conn(0x7f0280071df0 msgr2=0x7f02800cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 shutdown_connections 2024-01-27T14:31:58.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.850+0000 7f0285dec640 1 -- 172.21.15.46:0/626324179 wait complete. 2024-01-27T14:31:58.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:31:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 Processor -- start 2024-01-27T14:31:58.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 -- start start 2024-01-27T14:31:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 0x7f8a680c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a680c90c0 0x7f8a68157670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a68158250 con 0x7f8a680c8460 2024-01-27T14:31:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a68158530 con 0x7f8a680c90c0 2024-01-27T14:31:58.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.963+0000 7f8a6eff8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815ac60 con 0x7f8a680c8080 2024-01-27T14:31:58.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.964+0000 7f8a6cd94640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 0x7f8a680c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:58.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.964+0000 7f8a67fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8a680c8460 0x7f8a681514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50084/0 (socket says 172.21.15.46:50084) 2024-01-27T14:31:58.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.964+0000 7f8a67fff640 1 -- 172.21.15.46:0/252705961 learned_addr learned my addr 172.21.15.46:0/252705961 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:58.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.966+0000 7f8a6d595640 1 --2- 172.21.15.46:0/252705961 >> v2:172.21.15.46:3300/0 conn(0x7f8a680c90c0 0x7f8a68157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:58.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.966+0000 7f8a677fe640 1 -- 172.21.15.46:0/252705961 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647631955 0 0) 0x7f8a68158250 con 0x7f8a680c8460 2024-01-27T14:31:58.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.966+0000 7f8a677fe640 1 -- 172.21.15.46:0/252705961 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a50003520 con 0x7f8a680c8460 2024-01-27T14:31:58.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.967+0000 7f8a6cd94640 1 -- 172.21.15.46:0/252705961 >> v2:172.21.15.46:3300/0 conn(0x7f8a680c90c0 msgr2=0x7f8a68157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:58.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.967+0000 7f8a6cd94640 1 --2- 172.21.15.46:0/252705961 >> v2:172.21.15.46:3300/0 conn(0x7f8a680c90c0 0x7f8a68157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.967+0000 7f8a6cd94640 1 -- 172.21.15.46:0/252705961 >> v1:172.21.15.73:6789/0 conn(0x7f8a680c8460 legacy=0x7f8a681514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.967+0000 7f8a6cd94640 1 -- 172.21.15.46:0/252705961 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6815af40 con 0x7f8a680c8080 2024-01-27T14:31:58.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.971+0000 7f8a6cd94640 1 --2- 172.21.15.46:0/252705961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 0x7f8a680c1fc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a580097a0 tx=0x7f8a5802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1450269d62ee1884 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:58.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.975+0000 7f8a677fe640 1 -- 172.21.15.46:0/252705961 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802e070 con 0x7f8a680c8080 2024-01-27T14:31:58.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.975+0000 7f8a677fe640 1 -- 172.21.15.46:0/252705961 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a580315a0 con 0x7f8a680c8080 2024-01-27T14:31:58.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.975+0000 7f8a677fe640 1 -- 172.21.15.46:0/252705961 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58031930 con 0x7f8a680c8080 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 -- 172.21.15.46:0/252705961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 msgr2=0x7f8a680c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/252705961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 0x7f8a680c1fc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a580097a0 tx=0x7f8a5802b840 comp rx=0 tx=0).stop 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 -- 172.21.15.46:0/252705961 shutdown_connections 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/252705961 >> v2:172.21.15.46:3300/0 conn(0x7f8a680c90c0 0x7f8a68157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/252705961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8080 0x7f8a680c1fc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 -- 172.21.15.46:0/252705961 >> 172.21.15.46:0/252705961 conn(0x7f8a68070e40 msgr2=0x7f8a68071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 -- 172.21.15.46:0/252705961 shutdown_connections 2024-01-27T14:31:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.976+0000 7f8a6eff8640 1 -- 172.21.15.46:0/252705961 wait complete. 2024-01-27T14:31:58.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.977+0000 7f8a6eff8640 1 Processor -- start 2024-01-27T14:31:58.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.977+0000 7f8a6eff8640 1 -- start start 2024-01-27T14:31:58.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a680c8080 0x7f8a68159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:58.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8460 0x7f8a681f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:58.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:58.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68149b30 con 0x7f8a680c90c0 2024-01-27T14:31:58.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6814d8b0 con 0x7f8a680c8080 2024-01-27T14:31:58.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.978+0000 7f8a6eff8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6814cc10 con 0x7f8a680c8460 2024-01-27T14:31:58.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.979+0000 7f8a6d595640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:58.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.979+0000 7f8a6cd94640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a680c8080 0x7f8a68159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:58.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.979+0000 7f8a67fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8460 0x7f8a681f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:58.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.979+0000 7f8a6d595640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37818/0 (socket says 172.21.15.46:37818) 2024-01-27T14:31:58.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.979+0000 7f8a6d595640 1 -- 172.21.15.46:0/1081335311 learned_addr learned my addr 172.21.15.46:0/1081335311 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:58.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.983+0000 7f8a6d595640 1 -- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8460 msgr2=0x7f8a681f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.983+0000 7f8a6d595640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8460 0x7f8a681f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.983+0000 7f8a6d595640 1 -- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a680c8080 msgr2=0x7f8a68159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:58.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.983+0000 7f8a6d595640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a680c8080 0x7f8a68159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:58.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.983+0000 7f8a6d595640 1 -- 172.21.15.46:0/1081335311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009400 con 0x7f8a680c90c0 2024-01-27T14:31:58.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.985+0000 7f8a6d595640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000cc30 tx=0x7f8a6000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:58.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.989+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000ce40 con 0x7f8a680c90c0 2024-01-27T14:31:58.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.989+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60003990 con 0x7f8a680c90c0 2024-01-27T14:31:58.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.989+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60003d20 con 0x7f8a680c90c0 2024-01-27T14:31:58.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.989+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6815bba0 con 0x7f8a680c90c0 2024-01-27T14:31:58.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.989+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6814d1d0 con 0x7f8a680c90c0 2024-01-27T14:31:58.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:58.990+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a680742e0 con 0x7f8a680c90c0 2024-01-27T14:31:59.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.255+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8a60003e80 con 0x7f8a680c90c0 2024-01-27T14:31:59.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.255+0000 7f8a657fa640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 0x7f8a5406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.255+0000 7f8a6cd94640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 0x7f8a5406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.256+0000 7f8a6cd94640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 0x7f8a5406d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a58036000 tx=0x7f8a5803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.271+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a600589f0 con 0x7f8a680c90c0 2024-01-27T14:31:59.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.271+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8a60054d30 con 0x7f8a680c90c0 2024-01-27T14:31:59.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.491+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a680c8950 con 0x7f8a680c90c0 2024-01-27T14:31:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.513+0000 7f8a657fa640 1 -- 172.21.15.46:0/1081335311 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6511 (secure 0 0 0) 0x7f8a6001d020 con 0x7f8a680c90c0 2024-01-27T14:31:59.511 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:31:59.511 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:31:58.322076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-27T14:31:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-27T14:31:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 msgr2=0x7f8a5406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 0x7f8a5406d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a58036000 tx=0x7f8a5803d040 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 msgr2=0x7f8a68144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000cc30 tx=0x7f8a6000a5c0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 shutdown_connections 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8a5406af20 0x7f8a5406d3e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680c90c0 0x7f8a68144750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a680c8460 0x7f8a681f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 --2- 172.21.15.46:0/1081335311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a680c8080 0x7f8a68159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 >> 172.21.15.46:0/1081335311 conn(0x7f8a68070e40 msgr2=0x7f8a68157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 shutdown_connections 2024-01-27T14:31:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.516+0000 7f8a6eff8640 1 -- 172.21.15.46:0/1081335311 wait complete. 2024-01-27T14:31:59.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:31:59.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.628+0000 7f09fb525640 1 Processor -- start 2024-01-27T14:31:59.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.628+0000 7f09fb525640 1 -- start start 2024-01-27T14:31:59.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.629+0000 7f09fb525640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.629+0000 7f09fb525640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09f40cd360 0x7f09f406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.629+0000 7f09fb525640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4153e10 con 0x7f09f406c460 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.629+0000 7f09fb525640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f406ba90 con 0x7f09f40cd360 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.629+0000 7f09fb525640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f415cce0 con 0x7f09f4153a30 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.630+0000 7f09f8ac0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09f40cd360 0x7f09f406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.630+0000 7f09f92c1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.630+0000 7f09f9ac2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09f406c460 0x7f09f4159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:50092/0 (socket says 172.21.15.46:50092) 2024-01-27T14:31:59.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.630+0000 7f09f9ac2640 1 -- 172.21.15.46:0/2009525691 learned_addr learned my addr 172.21.15.46:0/2009525691 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:31:59.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.632+0000 7f09f8ac0640 1 -- 172.21.15.46:0/2009525691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 msgr2=0x7f09f40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:31:59.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.632+0000 7f09f8ac0640 1 --2- 172.21.15.46:0/2009525691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f40cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.632+0000 7f09f8ac0640 1 -- 172.21.15.46:0/2009525691 >> v1:172.21.15.73:6789/0 conn(0x7f09f406c460 legacy=0x7f09f4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.632+0000 7f09f8ac0640 1 -- 172.21.15.46:0/2009525691 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f406c8c0 con 0x7f09f40cd360 2024-01-27T14:31:59.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.634+0000 7f09f8ac0640 1 --2- 172.21.15.46:0/2009525691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f406bf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09e40097a0 tx=0x7f09e402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f850f76f3622872 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:59.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.638+0000 7f09ebfff640 1 -- 172.21.15.46:0/2009525691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4030610 con 0x7f09f40cd360 2024-01-27T14:31:59.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.638+0000 7f09ebfff640 1 -- 172.21.15.46:0/2009525691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4030770 con 0x7f09f40cd360 2024-01-27T14:31:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.638+0000 7f09ebfff640 1 -- 172.21.15.46:0/2009525691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4030b00 con 0x7f09f40cd360 2024-01-27T14:31:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 -- 172.21.15.46:0/2009525691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 msgr2=0x7f09f406bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 --2- 172.21.15.46:0/2009525691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f406bf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09e40097a0 tx=0x7f09e402b960 comp rx=0 tx=0).stop 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 -- 172.21.15.46:0/2009525691 shutdown_connections 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 --2- 172.21.15.46:0/2009525691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f406bf20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 --2- 172.21.15.46:0/2009525691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 -- 172.21.15.46:0/2009525691 >> 172.21.15.46:0/2009525691 conn(0x7f09f406a6c0 msgr2=0x7f09f406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 -- 172.21.15.46:0/2009525691 shutdown_connections 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.639+0000 7f09fb525640 1 -- 172.21.15.46:0/2009525691 wait complete. 2024-01-27T14:31:59.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.640+0000 7f09fb525640 1 Processor -- start 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.640+0000 7f09fb525640 1 -- start start 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f406c460 0x7f09f41e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40cae40 con 0x7f09f40cd360 2024-01-27T14:31:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b0060 con 0x7f09f406c460 2024-01-27T14:31:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09fb525640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f41f3640 con 0x7f09f4153a30 2024-01-27T14:31:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09f9ac2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.641+0000 7f09f92c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f406c460 0x7f09f41e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.642+0000 7f09f9ac2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:35658/0 (socket says 172.21.15.46:35658) 2024-01-27T14:31:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.642+0000 7f09f9ac2640 1 -- 172.21.15.46:0/3642220612 learned_addr learned my addr 172.21.15.46:0/3642220612 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:31:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.643+0000 7f09f8ac0640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.645+0000 7f09f9ac2640 1 -- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f406c460 msgr2=0x7f09f41e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.645+0000 7f09f9ac2640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f406c460 0x7f09f41e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.645+0000 7f09f9ac2640 1 -- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 msgr2=0x7f09f41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:31:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.645+0000 7f09f9ac2640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:31:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.645+0000 7f09f9ac2640 1 -- 172.21.15.46:0/3642220612 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e4009400 con 0x7f09f4153a30 2024-01-27T14:31:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.650+0000 7f09f9ac2640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00cbc0 tx=0x7f09ec00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.654+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00ad40 con 0x7f09f4153a30 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.654+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec012400 con 0x7f09f4153a30 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.654+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00aea0 con 0x7f09f4153a30 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.654+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40cc2e0 con 0x7f09f4153a30 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.654+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f41f0660 con 0x7f09f4153a30 2024-01-27T14:31:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.655+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f406d960 con 0x7f09f4153a30 2024-01-27T14:31:59.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.675+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f09ec007070 con 0x7f09f4153a30 2024-01-27T14:31:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.675+0000 7f09e9ffb640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 0x7f09d806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:31:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.675+0000 7f09f92c1640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 0x7f09d806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:31:59.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.676+0000 7f09f92c1640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 0x7f09d806d410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009aa0 tx=0x7f09f0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:31:59.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.679+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f09ec058620 con 0x7f09f4153a30 2024-01-27T14:31:59.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:31:59.920+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f09ec054960 con 0x7f09f4153a30 2024-01-27T14:32:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.106+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09f40742e0 con 0x7f09f4153a30 2024-01-27T14:32:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.152+0000 7f09e9ffb640 1 -- 172.21.15.46:0/3642220612 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f09ec017090 con 0x7f09f4153a30 2024-01-27T14:32:00.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:00.150 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:58.317122+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:00.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 msgr2=0x7f09d806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 0x7f09d806d410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009aa0 tx=0x7f09f0009190 comp rx=0 tx=0).stop 2024-01-27T14:32:00.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 msgr2=0x7f09f4151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00cbc0 tx=0x7f09ec00a430 comp rx=0 tx=0).stop 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 shutdown_connections 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f09d806af50 0x7f09d806d410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09f4153a30 0x7f09f4151a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09f40cd360 0x7f09f41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 --2- 172.21.15.46:0/3642220612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f406c460 0x7f09f41e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 >> 172.21.15.46:0/3642220612 conn(0x7f09f406a6c0 msgr2=0x7f09f40c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 shutdown_connections 2024-01-27T14:32:00.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.154+0000 7f09fb525640 1 -- 172.21.15.46:0/3642220612 wait complete. 2024-01-27T14:32:00.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.266+0000 7f981c25c640 1 Processor -- start 2024-01-27T14:32:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.266+0000 7f981c25c640 1 -- start start 2024-01-27T14:32:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.266+0000 7f981c25c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98140b3730 0x7f98140b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.266+0000 7f981c25c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140b3280 con 0x7f98140cf2c0 2024-01-27T14:32:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.267+0000 7f981c25c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981415d0d0 con 0x7f9814153b00 2024-01-27T14:32:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.267+0000 7f981c25c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981415a8a0 con 0x7f98140b3730 2024-01-27T14:32:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.267+0000 7f98197f7640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f98140cf2c0 0x7f98140ca0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48526/0 (socket says 172.21.15.46:48526) 2024-01-27T14:32:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.267+0000 7f98197f7640 1 -- 172.21.15.46:0/31117462 learned_addr learned my addr 172.21.15.46:0/31117462 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.267+0000 7f981a7f9640 1 --2- 172.21.15.46:0/31117462 >> v2:172.21.15.73:3300/0 conn(0x7f98140b3730 0x7f98140b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.270+0000 7f9818ff6640 1 -- 172.21.15.46:0/31117462 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627035762 0 0) 0x7f98140b3280 con 0x7f98140cf2c0 2024-01-27T14:32:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.270+0000 7f9818ff6640 1 -- 172.21.15.46:0/31117462 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800003520 con 0x7f98140cf2c0 2024-01-27T14:32:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.270+0000 7f981a7f9640 1 -- 172.21.15.46:0/31117462 >> v1:172.21.15.73:6789/0 conn(0x7f9814153b00 legacy=0x7f98140cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.271+0000 7f981a7f9640 1 -- 172.21.15.46:0/31117462 >> v1:172.21.15.46:6789/0 conn(0x7f98140cf2c0 legacy=0x7f98140ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.271+0000 7f981a7f9640 1 -- 172.21.15.46:0/31117462 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981415ce00 con 0x7f98140b3730 2024-01-27T14:32:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.275+0000 7f981a7f9640 1 --2- 172.21.15.46:0/31117462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140b3b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dc0 tx=0x7f980c02bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e743847f66554ab6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f9818ff6640 1 -- 172.21.15.46:0/31117462 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c02cd60 con 0x7f98140b3730 2024-01-27T14:32:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f9818ff6640 1 -- 172.21.15.46:0/31117462 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c034440 con 0x7f98140b3730 2024-01-27T14:32:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f9818ff6640 1 -- 172.21.15.46:0/31117462 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0347d0 con 0x7f98140b3730 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 -- 172.21.15.46:0/31117462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 msgr2=0x7f98140b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 --2- 172.21.15.46:0/31117462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140b3b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dc0 tx=0x7f980c02bfb0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 -- 172.21.15.46:0/31117462 shutdown_connections 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 --2- 172.21.15.46:0/31117462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140b3b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 -- 172.21.15.46:0/31117462 >> 172.21.15.46:0/31117462 conn(0x7f981408b190 msgr2=0x7f981408b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 -- 172.21.15.46:0/31117462 shutdown_connections 2024-01-27T14:32:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.279+0000 7f981c25c640 1 -- 172.21.15.46:0/31117462 wait complete. 2024-01-27T14:32:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.280+0000 7f981c25c640 1 Processor -- start 2024-01-27T14:32:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.280+0000 7f981c25c640 1 -- start start 2024-01-27T14:32:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 0x7f98140c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9814153b00 0x7f98140c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98141ef430 con 0x7f98140cf2c0 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98141f3710 con 0x7f98140b3730 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.281+0000 7f981c25c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98141ef6f0 con 0x7f9814153b00 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.282+0000 7f98197f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 0x7f98140c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.282+0000 7f9819ff8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.282+0000 7f981a7f9640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9814153b00 0x7f98140c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.282+0000 7f98197f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 0x7f98140c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37840/0 (socket says 172.21.15.46:37840) 2024-01-27T14:32:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.282+0000 7f98197f7640 1 -- 172.21.15.46:0/262798511 learned_addr learned my addr 172.21.15.46:0/262798511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.285+0000 7f9819ff8640 1 -- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9814153b00 msgr2=0x7f98140c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.285+0000 7f9819ff8640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9814153b00 0x7f98140c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.285+0000 7f9819ff8640 1 -- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 msgr2=0x7f98140c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.285+0000 7f9819ff8640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 0x7f98140c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.285+0000 7f9819ff8640 1 -- 172.21.15.46:0/262798511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c009a70 con 0x7f98140b3730 2024-01-27T14:32:00.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.288+0000 7f9819ff8640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140c5230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f981000c3c0 tx=0x7f981000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.290+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100052d0 con 0x7f98140b3730 2024-01-27T14:32:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.290+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98141ef9d0 con 0x7f98140b3730 2024-01-27T14:32:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.290+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98141eff90 con 0x7f98140b3730 2024-01-27T14:32:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.291+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98141f01a0 con 0x7f98140b3730 2024-01-27T14:32:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.291+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810001000 con 0x7f98140b3730 2024-01-27T14:32:00.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.291+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810007020 con 0x7f98140b3730 2024-01-27T14:32:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.540+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9810007180 con 0x7f98140b3730 2024-01-27T14:32:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.540+0000 7f980a7fc640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 0x7f97f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.541+0000 7f98197f7640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 0x7f97f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.541+0000 7f98197f7640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 0x7f97f806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98140c8c60 tx=0x7f9804009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.544+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9810057970 con 0x7f98140b3730 2024-01-27T14:32:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.554+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9810053cb0 con 0x7f98140b3730 2024-01-27T14:32:00.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.739+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98140742e0 con 0x7f98140b3730 2024-01-27T14:32:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.791+0000 7f980a7fc640 1 -- 172.21.15.46:0/262798511 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f9810020020 con 0x7f98140b3730 2024-01-27T14:32:00.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:00.788 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:58.317122+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:00.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 msgr2=0x7f97f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 0x7f97f806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98140c8c60 tx=0x7f9804009040 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 msgr2=0x7f98140c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140c5230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f981000c3c0 tx=0x7f981000c880 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 shutdown_connections 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f97f806af00 0x7f97f806d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9814153b00 0x7f98140c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98140cf2c0 0x7f98140c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 --2- 172.21.15.46:0/262798511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98140b3730 0x7f98140c5230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 >> 172.21.15.46:0/262798511 conn(0x7f981408b190 msgr2=0x7f98140cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 shutdown_connections 2024-01-27T14:32:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.792+0000 7f981c25c640 1 -- 172.21.15.46:0/262798511 wait complete. 2024-01-27T14:32:00.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:32:00.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.918+0000 7f9cc6d05640 1 Processor -- start 2024-01-27T14:32:00.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.918+0000 7f9cc6d05640 1 -- start start 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc6d05640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 0x7f9cc015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc6d05640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00c6470 con 0x7f9cc00cc0c0 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc6d05640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc015d210 con 0x7f9cc015a410 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc6d05640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00cb270 con 0x7f9cc0153aa0 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc52a2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9cc00cc0c0 0x7f9cc0164060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48536/0 (socket says 172.21.15.46:48536) 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc52a2640 1 -- 172.21.15.46:0/3752793708 learned_addr learned my addr 172.21.15.46:0/3752793708 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:00.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.919+0000 7f9cc4aa1640 1 --2- 172.21.15.46:0/3752793708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 0x7f9cc015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144605858 0 0) 0x7f9cc015d210 con 0x7f9cc015a410 2024-01-27T14:32:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca8003520 con 0x7f9cc015a410 2024-01-27T14:32:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547712530 0 0) 0x7f9cc00c6470 con 0x7f9cc00cc0c0 2024-01-27T14:32:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cc4aa1640 1 -- 172.21.15.46:0/3752793708 >> v1:172.21.15.73:6789/0 conn(0x7f9cc015a410 legacy=0x7f9cc00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cc4aa1640 1 -- 172.21.15.46:0/3752793708 >> v1:172.21.15.46:6789/0 conn(0x7f9cc00cc0c0 legacy=0x7f9cc0164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.922+0000 7f9cc4aa1640 1 -- 172.21.15.46:0/3752793708 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00cacf0 con 0x7f9cc0153aa0 2024-01-27T14:32:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.924+0000 7f9cc4aa1640 1 --2- 172.21.15.46:0/3752793708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 0x7f9cc015ccd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009dc0 tx=0x7f9cb802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abad72e9620003 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.927+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb802ccd0 con 0x7f9cc0153aa0 2024-01-27T14:32:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.927+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb802ce30 con 0x7f9cc0153aa0 2024-01-27T14:32:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.927+0000 7f9cbf7fe640 1 -- 172.21.15.46:0/3752793708 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8034660 con 0x7f9cc0153aa0 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3752793708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 msgr2=0x7f9cc015ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3752793708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 0x7f9cc015ccd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009dc0 tx=0x7f9cb802bf20 comp rx=0 tx=0).stop 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3752793708 shutdown_connections 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3752793708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc0153aa0 0x7f9cc015ccd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3752793708 >> 172.21.15.46:0/3752793708 conn(0x7f9cc0071df0 msgr2=0x7f9cc0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3752793708 shutdown_connections 2024-01-27T14:32:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.928+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3752793708 wait complete. 2024-01-27T14:32:00.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.929+0000 7f9cc6d05640 1 Processor -- start 2024-01-27T14:32:00.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.929+0000 7f9cc6d05640 1 -- start start 2024-01-27T14:32:00.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc00cc0c0 0x7f9cc01efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc015a410 0x7f9cc00bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00c5530 con 0x7f9cc015a410 2024-01-27T14:32:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01f0040 con 0x7f9cc0153aa0 2024-01-27T14:32:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.930+0000 7f9cc6d05640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01f04f0 con 0x7f9cc00cc0c0 2024-01-27T14:32:00.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.931+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.931+0000 7f9cc4aa1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc00cc0c0 0x7f9cc01efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.931+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47286/0 (socket says 172.21.15.46:47286) 2024-01-27T14:32:00.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.931+0000 7f9cbffff640 1 -- 172.21.15.46:0/3383567051 learned_addr learned my addr 172.21.15.46:0/3383567051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:00.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.934+0000 7f9cc52a2640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc015a410 0x7f9cc00bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:00.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.936+0000 7f9cbffff640 1 -- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc00cc0c0 msgr2=0x7f9cc01efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.936+0000 7f9cbffff640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc00cc0c0 0x7f9cc01efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.936+0000 7f9cbffff640 1 -- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc015a410 msgr2=0x7f9cc00bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.936+0000 7f9cbffff640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc015a410 0x7f9cc00bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.936+0000 7f9cbffff640 1 -- 172.21.15.46:0/3383567051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009a70 con 0x7f9cc0153aa0 2024-01-27T14:32:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.940+0000 7f9cbffff640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c490 tx=0x7f9cb400c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.944+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40052d0 con 0x7f9cc0153aa0 2024-01-27T14:32:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.944+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4005430 con 0x7f9cc0153aa0 2024-01-27T14:32:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.944+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4012870 con 0x7f9cc0153aa0 2024-01-27T14:32:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.944+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc015ca80 con 0x7f9cc0153aa0 2024-01-27T14:32:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.944+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc015d040 con 0x7f9cc0153aa0 2024-01-27T14:32:00.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:00.945+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc00c2930 con 0x7f9cc0153aa0 2024-01-27T14:32:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.187+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9cb40129d0 con 0x7f9cc0153aa0 2024-01-27T14:32:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.187+0000 7f9cbd7fa640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 0x7f9cac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.188+0000 7f9cc4aa1640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 0x7f9cac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.188+0000 7f9cc4aa1640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 0x7f9cac06d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8036000 tx=0x7f9cb8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.190+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9cb4058880 con 0x7f9cc0153aa0 2024-01-27T14:32:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.201+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9cb4054bc0 con 0x7f9cc0153aa0 2024-01-27T14:32:01.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.419+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cc00742e0 con 0x7f9cc0153aa0 2024-01-27T14:32:01.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.442+0000 7f9cbd7fa640 1 -- 172.21.15.46:0/3383567051 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6511 (secure 0 0 0) 0x7f9cb40581e0 con 0x7f9cc0153aa0 2024-01-27T14:32:01.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:01.439 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:31:58.322076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-27T14:32:01.439 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-27T14:32:01.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 msgr2=0x7f9cac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 0x7f9cac06d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8036000 tx=0x7f9cb8030000 comp rx=0 tx=0).stop 2024-01-27T14:32:01.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 msgr2=0x7f9cc015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c490 tx=0x7f9cb400c950 comp rx=0 tx=0).stop 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 shutdown_connections 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9cac06af50 0x7f9cac06d410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc0153aa0 0x7f9cc015b240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc015a410 0x7f9cc00bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 --2- 172.21.15.46:0/3383567051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9cc00cc0c0 0x7f9cc01efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 >> 172.21.15.46:0/3383567051 conn(0x7f9cc0071df0 msgr2=0x7f9cc0152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 shutdown_connections 2024-01-27T14:32:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.444+0000 7f9cc6d05640 1 -- 172.21.15.46:0/3383567051 wait complete. 2024-01-27T14:32:01.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:01.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 Processor -- start 2024-01-27T14:32:01.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 -- start start 2024-01-27T14:32:01.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93540c1900 con 0x7f935406dee0 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93540c7610 con 0x7f9354156fb0 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.556+0000 7f9358897640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9354070740 con 0x7f935406e650 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.557+0000 7f934bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f935406dee0 0x7f93540c88e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48544/0 (socket says 172.21.15.46:48544) 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.557+0000 7f934bfff640 1 -- 172.21.15.46:0/3655059033 learned_addr learned my addr 172.21.15.46:0/3655059033 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.557+0000 7f9352d9d640 1 --2- 172.21.15.46:0/3655059033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.559+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140156197 0 0) 0x7f93540c7610 con 0x7f9354156fb0 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.559+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9340003520 con 0x7f9354156fb0 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.559+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792624436 0 0) 0x7f93540c1900 con 0x7f935406dee0 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.559+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93540c7610 con 0x7f935406dee0 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.560+0000 7f9352d9d640 1 -- 172.21.15.46:0/3655059033 >> v1:172.21.15.73:6789/0 conn(0x7f9354156fb0 legacy=0x7f935406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.560+0000 7f9352d9d640 1 -- 172.21.15.46:0/3655059033 >> v1:172.21.15.46:6789/0 conn(0x7f935406dee0 legacy=0x7f93540c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.560+0000 7f9352d9d640 1 -- 172.21.15.46:0/3655059033 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540c78f0 con 0x7f935406e650 2024-01-27T14:32:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.561+0000 7f9352d9d640 1 --2- 172.21.15.46:0/3655059033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935406eac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f934c009dc0 tx=0x7f934c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36af45d77f93058 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c02cd50 con 0x7f935406e650 2024-01-27T14:32:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c034440 con 0x7f935406e650 2024-01-27T14:32:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9351d9b640 1 -- 172.21.15.46:0/3655059033 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0347d0 con 0x7f935406e650 2024-01-27T14:32:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 -- 172.21.15.46:0/3655059033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 msgr2=0x7f935406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 --2- 172.21.15.46:0/3655059033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935406eac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f934c009dc0 tx=0x7f934c02bfa0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 -- 172.21.15.46:0/3655059033 shutdown_connections 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 --2- 172.21.15.46:0/3655059033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935406eac0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 -- 172.21.15.46:0/3655059033 >> 172.21.15.46:0/3655059033 conn(0x7f9354072750 msgr2=0x7f935406b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 -- 172.21.15.46:0/3655059033 shutdown_connections 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.566+0000 7f9358897640 1 -- 172.21.15.46:0/3655059033 wait complete. 2024-01-27T14:32:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.567+0000 7f9358897640 1 Processor -- start 2024-01-27T14:32:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.567+0000 7f9358897640 1 -- start start 2024-01-27T14:32:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f935406dee0 0x7f935414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93540caef0 con 0x7f9354156fb0 2024-01-27T14:32:01.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93540cb1d0 con 0x7f935406dee0 2024-01-27T14:32:01.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9358897640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935414b070 con 0x7f935406e650 2024-01-27T14:32:01.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.568+0000 7f9352d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.569+0000 7f934bfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.569+0000 7f9352d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37868/0 (socket says 172.21.15.46:37868) 2024-01-27T14:32:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.569+0000 7f9352d9d640 1 -- 172.21.15.46:0/2158254620 learned_addr learned my addr 172.21.15.46:0/2158254620 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.569+0000 7f935259c640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f935406dee0 0x7f935414b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.573+0000 7f9352d9d640 1 -- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 msgr2=0x7f935414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.573+0000 7f9352d9d640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.573+0000 7f9352d9d640 1 -- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f935406dee0 msgr2=0x7f935414b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.573+0000 7f9352d9d640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f935406dee0 0x7f935414b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.573+0000 7f9352d9d640 1 -- 172.21.15.46:0/2158254620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009a70 con 0x7f9354156fb0 2024-01-27T14:32:01.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.575+0000 7f9352d9d640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f934c009ee0 tx=0x7f934c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c03e410 con 0x7f9354156fb0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c03e570 con 0x7f9354156fb0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c03e900 con 0x7f9354156fb0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935414b350 con 0x7f9354156fb0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93540cc6c0 con 0x7f9354156fb0 2024-01-27T14:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.579+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9354066f20 con 0x7f9354156fb0 2024-01-27T14:32:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.846+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f934c03b050 con 0x7f9354156fb0 2024-01-27T14:32:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.847+0000 7f934affd640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 0x7f933406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.847+0000 7f935259c640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 0x7f933406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.847+0000 7f935259c640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 0x7f933406d3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9344001710 tx=0x7f9344009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.863+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f934c054e20 con 0x7f9354156fb0 2024-01-27T14:32:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:01.863+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f934c077160 con 0x7f9354156fb0 2024-01-27T14:32:02.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.051+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f935414aed0 con 0x7f9354156fb0 2024-01-27T14:32:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.103+0000 7f934affd640 1 -- 172.21.15.46:0/2158254620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f935414aed0 con 0x7f9354156fb0 2024-01-27T14:32:02.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:02.101 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:58.317122+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 msgr2=0x7f933406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 0x7f933406d3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9344001710 tx=0x7f9344009040 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 msgr2=0x7f93541f28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f934c009ee0 tx=0x7f934c004a40 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 shutdown_connections 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f933406af20 0x7f933406d3e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9354156fb0 0x7f93541f28d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f935406e650 0x7f935414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 --2- 172.21.15.46:0/2158254620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f935406dee0 0x7f935414b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 >> 172.21.15.46:0/2158254620 conn(0x7f9354072750 msgr2=0x7f9354151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 shutdown_connections 2024-01-27T14:32:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.105+0000 7f9358897640 1 -- 172.21.15.46:0/2158254620 wait complete. 2024-01-27T14:32:02.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-27T14:31:51.484410+0000', 'modified': '2024-01-27T14:31:58.322076+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6837/2525471575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 2525471575}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2525471575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-27T14:32:02.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-27T14:32:02.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-27T14:32:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.837+0000 7f2e36a77640 1 Processor -- start 2024-01-27T14:32:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 -- start start 2024-01-27T14:32:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e30071190 0x7f2e3006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e30156590 con 0x7f2e301507e0 2024-01-27T14:32:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300c19f0 con 0x7f2e30071190 2024-01-27T14:32:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.838+0000 7f2e36a77640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30071620 con 0x7f2e30072450 2024-01-27T14:32:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.839+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.839+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:35714/0 (socket says 172.21.15.46:35714) 2024-01-27T14:32:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.839+0000 7f2e2ffff640 1 -- 172.21.15.46:0/1205322077 learned_addr learned my addr 172.21.15.46:0/1205322077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.840+0000 7f2e35014640 1 --2- 172.21.15.46:0/1205322077 >> v2:172.21.15.46:3300/0 conn(0x7f2e30071190 0x7f2e3006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.842+0000 7f2e2ffff640 1 -- 172.21.15.46:0/1205322077 >> v2:172.21.15.46:3300/0 conn(0x7f2e30071190 msgr2=0x7f2e3006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.842+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/1205322077 >> v2:172.21.15.46:3300/0 conn(0x7f2e30071190 0x7f2e3006da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.842+0000 7f2e2ffff640 1 -- 172.21.15.46:0/1205322077 >> v1:172.21.15.46:6789/0 conn(0x7f2e301507e0 legacy=0x7f2e301599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.842+0000 7f2e2ffff640 1 -- 172.21.15.46:0/1205322077 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30150bc0 con 0x7f2e30072450 2024-01-27T14:32:02.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.844+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/1205322077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009870 tx=0x7f2e1c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=691c70e56fffc6e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.848+0000 7f2e2f7fe640 1 -- 172.21.15.46:0/1205322077 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c02f840 con 0x7f2e30072450 2024-01-27T14:32:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.848+0000 7f2e2f7fe640 1 -- 172.21.15.46:0/1205322077 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c02f9a0 con 0x7f2e30072450 2024-01-27T14:32:02.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.848+0000 7f2e2f7fe640 1 -- 172.21.15.46:0/1205322077 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c02fd30 con 0x7f2e30072450 2024-01-27T14:32:02.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 -- 172.21.15.46:0/1205322077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 msgr2=0x7f2e30157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 --2- 172.21.15.46:0/1205322077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009870 tx=0x7f2e1c02ba20 comp rx=0 tx=0).stop 2024-01-27T14:32:02.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 -- 172.21.15.46:0/1205322077 shutdown_connections 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 --2- 172.21.15.46:0/1205322077 >> v2:172.21.15.46:3300/0 conn(0x7f2e30071190 0x7f2e3006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 --2- 172.21.15.46:0/1205322077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e30072450 0x7f2e30157030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 -- 172.21.15.46:0/1205322077 >> 172.21.15.46:0/1205322077 conn(0x7f2e300c7a00 msgr2=0x7f2e300c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 -- 172.21.15.46:0/1205322077 shutdown_connections 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.849+0000 7f2e36a77640 1 -- 172.21.15.46:0/1205322077 wait complete. 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.850+0000 7f2e36a77640 1 Processor -- start 2024-01-27T14:32:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.850+0000 7f2e36a77640 1 -- start start 2024-01-27T14:32:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e30072450 0x7f2e300c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e301507e0 0x7f2e301f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300afe60 con 0x7f2e30071190 2024-01-27T14:32:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300c32f0 con 0x7f2e30072450 2024-01-27T14:32:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.851+0000 7f2e36a77640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300b00b0 con 0x7f2e301507e0 2024-01-27T14:32:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.852+0000 7f2e34813640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.852+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e301507e0 0x7f2e301f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.852+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e30072450 0x7f2e300c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.852+0000 7f2e34813640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37892/0 (socket says 172.21.15.46:37892) 2024-01-27T14:32:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.852+0000 7f2e34813640 1 -- 172.21.15.46:0/13511581 learned_addr learned my addr 172.21.15.46:0/13511581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.855+0000 7f2e34813640 1 -- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e301507e0 msgr2=0x7f2e301f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.855+0000 7f2e34813640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e301507e0 0x7f2e301f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.855+0000 7f2e34813640 1 -- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e30072450 msgr2=0x7f2e300c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.855+0000 7f2e34813640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e30072450 0x7f2e300c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.855+0000 7f2e34813640 1 -- 172.21.15.46:0/13511581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0094d0 con 0x7f2e30071190 2024-01-27T14:32:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.858+0000 7f2e34813640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c3c0 tx=0x7f2e2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.862+0000 7f2e2d7fa640 1 -- 172.21.15.46:0/13511581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240052d0 con 0x7f2e30071190 2024-01-27T14:32:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.862+0000 7f2e2d7fa640 1 -- 172.21.15.46:0/13511581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24005450 con 0x7f2e30071190 2024-01-27T14:32:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.862+0000 7f2e2d7fa640 1 -- 172.21.15.46:0/13511581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24007260 con 0x7f2e30071190 2024-01-27T14:32:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.862+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e300b0390 con 0x7f2e30071190 2024-01-27T14:32:02.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.862+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e300c2810 con 0x7f2e30071190 2024-01-27T14:32:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.864+0000 7f2e39642740 1 Processor -- start 2024-01-27T14:32:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 -- start start 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da6fcb0 0x56101da2fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 0x56101da70670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 0x56101da6ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101d99d030 con 0x56101da6fcb0 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101d99a720 con 0x56101da2e750 2024-01-27T14:32:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.865+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101d996010 con 0x56101da70090 2024-01-27T14:32:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.866+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 0x56101da6ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.866+0000 7f2e34813640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 0x56101da70670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.866+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 0x56101da6ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:35740/0 (socket says 172.21.15.46:35740) 2024-01-27T14:32:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.866+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2993490059 learned_addr learned my addr 172.21.15.46:0/2993490059 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.869+0000 7f2e34813640 1 -- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 msgr2=0x56101da6ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.869+0000 7f2e34813640 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 0x56101da6ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.869+0000 7f2e34813640 1 -- 172.21.15.46:0/2993490059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da6fcb0 msgr2=0x56101da2fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.869+0000 7f2e34813640 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da6fcb0 0x56101da2fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.869+0000 7f2e34813640 1 -- 172.21.15.46:0/2993490059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56101d958680 con 0x56101da2e750 2024-01-27T14:32:02.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.871+0000 7f2e34813640 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 0x56101da70670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e24013000 tx=0x7f2e24011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e43aa5dfff5f35 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:02.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.875+0000 7f2e1a7fc640 1 -- 172.21.15.46:0/2993490059 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24003cc0 con 0x56101da2e750 2024-01-27T14:32:02.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.875+0000 7f2e1a7fc640 1 -- 172.21.15.46:0/2993490059 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24003e20 con 0x56101da2e750 2024-01-27T14:32:02.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.875+0000 7f2e1a7fc640 1 -- 172.21.15.46:0/2993490059 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240117b0 con 0x56101da2e750 2024-01-27T14:32:02.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 msgr2=0x56101da70670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:02.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 0x56101da70670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e24013000 tx=0x7f2e24011000 comp rx=0 tx=0).stop 2024-01-27T14:32:02.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- 172.21.15.46:0/2993490059 shutdown_connections 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da2e750 0x56101da70670 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da70090 0x56101da6ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 --2- 172.21.15.46:0/2993490059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da6fcb0 0x56101da2fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- 172.21.15.46:0/2993490059 >> 172.21.15.46:0/2993490059 conn(0x56101da2b8c0 msgr2=0x56101da2f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- 172.21.15.46:0/2993490059 shutdown_connections 2024-01-27T14:32:02.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- 172.21.15.46:0/2993490059 wait complete. 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.876+0000 7f2e39642740 1 -- start start 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 Processor -- start 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 0x56101da70c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da70090 0x56101da57e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101d94f5f0 con 0x56101da70090 2024-01-27T14:32:02.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101d94f290 con 0x56101da6fcb0 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101d914300 con 0x56101da572e0 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.877+0000 7f2e39642740 10 client.0 _ll_register_callbacks cb 0x56101d94a260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.878+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.878+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 0x56101da70c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.878+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:35756/0 (socket says 172.21.15.46:35756) 2024-01-27T14:32:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.878+0000 7f2e2ffff640 1 -- 172.21.15.46:0/3067978625 learned_addr learned my addr 172.21.15.46:0/3067978625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:02.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e35014640 1 -- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 msgr2=0x56101da72700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:02.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e35014640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e35014640 1 -- 172.21.15.46:0/3067978625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da70090 msgr2=0x56101da57e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e35014640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da70090 0x56101da57e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e35014640 1 -- 172.21.15.46:0/3067978625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e300c2810 con 0x56101da6fcb0 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.882+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.883+0000 7f2e2d7fa640 1 -- 172.21.15.46:0/13511581 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2e24003ac0 con 0x7f2e30071190 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.883+0000 7f2e2d7fa640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 0x7f2e1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.884+0000 7f2e34813640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 0x7f2e1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.884+0000 7f2e34813640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 0x7f2e1406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e24059a20 tx=0x7f2e24068040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:02.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.885+0000 7f2e35014640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 0x56101da70c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e28011ce0 tx=0x7f2e2800f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc3903aa355e6f1c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:02.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.885+0000 7f2e0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-01-27T14:32:02.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.888+0000 7f2e2d7fa640 1 -- 172.21.15.46:0/13511581 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e24062c30 con 0x7f2e30071190 2024-01-27T14:32:02.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.889+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800e040 con 0x56101da6fcb0 2024-01-27T14:32:02.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.889+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e2800fe10 con 0x56101da6fcb0 2024-01-27T14:32:02.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.889+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56101d98eea0 con 0x56101da6fcb0 2024-01-27T14:32:02.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.891+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28003990 con 0x56101da6fcb0 2024-01-27T14:32:02.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.891+0000 7f2e39642740 10 client.4372 fetch_fsmap learned FSMap version 7 2024-01-27T14:32:02.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.891+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56101d994690 con 0x56101da6fcb0 2024-01-27T14:32:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.904+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28024020 con 0x56101da6fcb0 2024-01-27T14:32:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.904+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f2e2801b020 con 0x56101da6fcb0 2024-01-27T14:32:02.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 10 client.4372 fetch_fsmap finished waiting for FSMap version 7 2024-01-27T14:32:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 10 client.4372 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-27T14:32:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 20 client.4372 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da29db0 0x56101da4d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 4 client.4372 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.905+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 --> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56101d98ebc0 con 0x56101da29db0 2024-01-27T14:32:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:02.913+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da29db0 0x56101da4d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:02.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.002+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da29db0 0x56101da4d7a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e08c562eb9e32f server_cookie=b17145824152a26d in_seq=0 out_seq=0 2024-01-27T14:32:02.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.002+0000 7f2e0f7fe640 10 client.4372 ms_handle_connect on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:03.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.120+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/3067978625 <== mds.0 v2:172.21.15.73:6836/2525471575 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56101d98ebc0 con 0x56101da29db0 2024-01-27T14:32:03.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.120+0000 7f2e0f7fe640 10 client.4372 handle_command_reply: tid=0 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.120+0000 7f2e39642740 1 client.4372 shutdown 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 msgr2=0x56101da70c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 0x56101da70c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e28011ce0 tx=0x7f2e2800f580 comp rx=0 tx=0).stop 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 shutdown_connections 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da29db0 0x56101da4d7a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da572e0 0x56101da72700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da70090 0x56101da57e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e0f7fe640 0 client.4372 ms_handle_reset on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 --2- 172.21.15.46:0/3067978625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da6fcb0 0x56101da70c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 >> 172.21.15.46:0/3067978625 conn(0x56101da2e750 msgr2=0x56101da2d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 shutdown_connections 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 1 -- 172.21.15.46:0/3067978625 wait complete. 2024-01-27T14:32:03.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.121+0000 7f2e39642740 20 client.4372 trim_cache size 0 max 16384 2024-01-27T14:32:03.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 Processor -- start 2024-01-27T14:32:03.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 -- start start 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da572e0 0x56101da2eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101da2f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101da73a20 con 0x56101da29db0 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101da29580 con 0x56101da572e0 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.137+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101da69f20 con 0x56101da6fcb0 2024-01-27T14:32:03.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.138+0000 7f2e35014640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.138+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da572e0 0x56101da2eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.138+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101da2f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.138+0000 7f2e35014640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37906/0 (socket says 172.21.15.46:37906) 2024-01-27T14:32:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.138+0000 7f2e35014640 1 -- 172.21.15.46:0/207275533 learned_addr learned my addr 172.21.15.46:0/207275533 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:03.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.140+0000 7f2e35014640 1 -- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 msgr2=0x56101da2f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.140+0000 7f2e35014640 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101da2f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.140+0000 7f2e35014640 1 -- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da572e0 msgr2=0x56101da2eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.140+0000 7f2e35014640 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da572e0 0x56101da2eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.140+0000 7f2e35014640 1 -- 172.21.15.46:0/207275533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56101d931390 con 0x56101da29db0 2024-01-27T14:32:03.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.142+0000 7f2e35014640 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b010 tx=0x7f2e28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7065ea90a57a47 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.146+0000 7f2e19ffb640 1 -- 172.21.15.46:0/207275533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800e030 con 0x56101da29db0 2024-01-27T14:32:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.146+0000 7f2e19ffb640 1 -- 172.21.15.46:0/207275533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28024040 con 0x56101da29db0 2024-01-27T14:32:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.146+0000 7f2e19ffb640 1 -- 172.21.15.46:0/207275533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28011b30 con 0x56101da29db0 2024-01-27T14:32:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- 172.21.15.46:0/207275533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 msgr2=0x56101da2ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b010 tx=0x7f2e28016000 comp rx=0 tx=0).stop 2024-01-27T14:32:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- 172.21.15.46:0/207275533 shutdown_connections 2024-01-27T14:32:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da572e0 0x56101da2eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101da2f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 --2- 172.21.15.46:0/207275533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da29db0 0x56101da2ce30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- 172.21.15.46:0/207275533 >> 172.21.15.46:0/207275533 conn(0x56101da2e750 msgr2=0x56101da54700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- 172.21.15.46:0/207275533 shutdown_connections 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- 172.21.15.46:0/207275533 wait complete. 2024-01-27T14:32:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 -- start start 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.147+0000 7f2e39642740 1 Processor -- start 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da572e0 0x56101da2da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101dad4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101da8a030 con 0x56101da572e0 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101dadab10 con 0x56101da29db0 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101da77c80 con 0x56101da6fcb0 2024-01-27T14:32:03.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.148+0000 7f2e39642740 10 client.0 _ll_register_callbacks cb 0x7f2e2401e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:03.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.149+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da572e0 0x56101da2da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.149+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101dad4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.149+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.149+0000 7f2e35014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:47356/0 (socket says 172.21.15.46:47356) 2024-01-27T14:32:03.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.149+0000 7f2e35014640 1 -- 172.21.15.46:0/2399996878 learned_addr learned my addr 172.21.15.46:0/2399996878 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:03.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.152+0000 7f2e35014640 1 -- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 msgr2=0x56101dad4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.152+0000 7f2e35014640 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101dad4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.152+0000 7f2e35014640 1 -- 172.21.15.46:0/2399996878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da572e0 msgr2=0x56101da2da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.152+0000 7f2e35014640 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da572e0 0x56101da2da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.152+0000 7f2e35014640 1 -- 172.21.15.46:0/2399996878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56101d994690 con 0x56101da29db0 2024-01-27T14:32:03.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.154+0000 7f2e35014640 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b010 tx=0x7f2e28017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157ab0e4fdfca8e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:03.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.154+0000 7f2e0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-01-27T14:32:03.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.157+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28015a70 con 0x56101da29db0 2024-01-27T14:32:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.157+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56101da55f80 con 0x56101da29db0 2024-01-27T14:32:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.158+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e28025080 con 0x56101da29db0 2024-01-27T14:32:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.160+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28011b30 con 0x56101da29db0 2024-01-27T14:32:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.160+0000 7f2e39642740 10 client.4378 fetch_fsmap learned FSMap version 7 2024-01-27T14:32:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.160+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56101d956ee0 con 0x56101da29db0 2024-01-27T14:32:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56101da55f80 con 0x56101da29db0 2024-01-27T14:32:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f2e2801b040 con 0x56101da29db0 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 10 client.4378 fetch_fsmap finished waiting for FSMap version 7 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 10 client.4378 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 20 client.4378 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da70090 0x56101da6c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 4 client.4378 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 --> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f2e24003e20 con 0x56101da70090 2024-01-27T14:32:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.164+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da70090 0x56101da6c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.167+0000 7f2e0f7fe640 10 client.4378 ms_handle_connect on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.167+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da70090 0x56101da6c1c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e45027e103a582 server_cookie=6cf360b388d78663 in_seq=0 out_seq=0 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e0f7fe640 1 -- 172.21.15.46:0/2399996878 <== mds.0 v2:172.21.15.73:6836/2525471575 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f2e24003e20 con 0x56101da70090 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e0f7fe640 10 client.4378 handle_command_reply: tid=0 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 client.4378 shutdown 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 msgr2=0x56101da56ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b010 tx=0x7f2e28017000 comp rx=0 tx=0).stop 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 shutdown_connections 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x56101da70090 0x56101da6c1c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56101da6fcb0 0x56101dad4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56101da572e0 0x56101da2da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 --2- 172.21.15.46:0/2399996878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56101da29db0 0x56101da56ca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e0f7fe640 0 client.4378 ms_handle_reset on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 >> 172.21.15.46:0/2399996878 conn(0x56101da2e750 msgr2=0x56101da2eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 shutdown_connections 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 1 -- 172.21.15.46:0/2399996878 wait complete. 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e39642740 20 client.4378 trim_cache size 0 max 16384 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4267, 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 10.546056500000001, 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 7, 2024-01-27T14:32:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 27, 2024-01-27T14:32:03.184 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 27, 2024-01-27T14:32:03.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 20.325795822 2024-01-27T14:32:03.184 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 msgr2=0x7f2e1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.185+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 0x7f2e1406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e24059a20 tx=0x7f2e24068040 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 msgr2=0x7f2e3006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c3c0 tx=0x7f2e2400c880 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 shutdown_connections 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2e1406ae40 0x7f2e1406d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e30072450 0x7f2e300c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2e301507e0 0x7f2e301f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 --2- 172.21.15.46:0/13511581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30071190 0x7f2e3006d210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 >> 172.21.15.46:0/13511581 conn(0x7f2e300c7a00 msgr2=0x7f2e30154170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 shutdown_connections 2024-01-27T14:32:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.186+0000 7f2e36a77640 1 -- 172.21.15.46:0/13511581 wait complete. 2024-01-27T14:32:03.193 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-27T14:32:03.193 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:03.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-27T14:32:03.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.299+0000 7f9fea69b640 1 Processor -- start 2024-01-27T14:32:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.299+0000 7f9fea69b640 1 -- start start 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fea69b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9fe4153b00 0x7f9fe40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fea69b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fe40cf2c0 0x7f9fe40ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fea69b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe40b3280 con 0x7f9fe40ca600 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fea69b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe415a8a0 con 0x7f9fe4153b00 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fea69b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe40caa10 con 0x7f9fe40cf2c0 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.300+0000 7f9fe3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9fe4153b00 0x7f9fe40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.301+0000 7f9fe37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fe40cf2c0 0x7f9fe40ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.301+0000 7f9fe3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9fe4153b00 0x7f9fe40cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37926/0 (socket says 172.21.15.46:37926) 2024-01-27T14:32:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.301+0000 7f9fe3fff640 1 -- 172.21.15.46:0/433753116 learned_addr learned my addr 172.21.15.46:0/433753116 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.303+0000 7f9fe3fff640 1 -- 172.21.15.46:0/433753116 >> v2:172.21.15.73:3300/0 conn(0x7f9fe40cf2c0 msgr2=0x7f9fe40ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.303+0000 7f9fe3fff640 1 --2- 172.21.15.46:0/433753116 >> v2:172.21.15.73:3300/0 conn(0x7f9fe40cf2c0 0x7f9fe40ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.303+0000 7f9fe3fff640 1 -- 172.21.15.46:0/433753116 >> v1:172.21.15.73:6789/0 conn(0x7f9fe40ca600 legacy=0x7f9fe40b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.303+0000 7f9fe3fff640 1 -- 172.21.15.46:0/433753116 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe415d0d0 con 0x7f9fe4153b00 2024-01-27T14:32:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.305+0000 7f9fe3fff640 1 --2- 172.21.15.46:0/433753116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe4153b00 0x7f9fe40cf7e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009870 tx=0x7f9fd802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207efdaae084376a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.309+0000 7f9fe2ffd640 1 -- 172.21.15.46:0/433753116 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8030860 con 0x7f9fe4153b00 2024-01-27T14:32:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.309+0000 7f9fe2ffd640 1 -- 172.21.15.46:0/433753116 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd80309c0 con 0x7f9fe4153b00 2024-01-27T14:32:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.309+0000 7f9fe2ffd640 1 -- 172.21.15.46:0/433753116 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8030d50 con 0x7f9fe4153b00 2024-01-27T14:32:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 -- 172.21.15.46:0/433753116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe4153b00 msgr2=0x7f9fe40cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 --2- 172.21.15.46:0/433753116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe4153b00 0x7f9fe40cf7e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009870 tx=0x7f9fd802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 -- 172.21.15.46:0/433753116 shutdown_connections 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 --2- 172.21.15.46:0/433753116 >> v2:172.21.15.73:3300/0 conn(0x7f9fe40cf2c0 0x7f9fe40ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 --2- 172.21.15.46:0/433753116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe4153b00 0x7f9fe40cf7e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 -- 172.21.15.46:0/433753116 >> 172.21.15.46:0/433753116 conn(0x7f9fe408b190 msgr2=0x7f9fe408b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 -- 172.21.15.46:0/433753116 shutdown_connections 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.310+0000 7f9fea69b640 1 -- 172.21.15.46:0/433753116 wait complete. 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.311+0000 7f9fea69b640 1 Processor -- start 2024-01-27T14:32:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.311+0000 7f9fea69b640 1 -- start start 2024-01-27T14:32:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fe40cf2c0 0x7f9fe40cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fe4153b00 0x7f9fe41f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4156570 con 0x7f9fe40ca600 2024-01-27T14:32:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe41f2740 con 0x7f9fe4153b00 2024-01-27T14:32:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fea69b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe41585a0 con 0x7f9fe40cf2c0 2024-01-27T14:32:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.312+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.313+0000 7f9fe37fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fe40cf2c0 0x7f9fe40cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.313+0000 7f9fe8c38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fe4153b00 0x7f9fe41f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.313+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37930/0 (socket says 172.21.15.46:37930) 2024-01-27T14:32:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.313+0000 7f9fe3fff640 1 -- 172.21.15.46:0/2459750189 learned_addr learned my addr 172.21.15.46:0/2459750189 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:03.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.316+0000 7f9fe3fff640 1 -- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fe40cf2c0 msgr2=0x7f9fe40cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.316+0000 7f9fe3fff640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fe40cf2c0 0x7f9fe40cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.316+0000 7f9fe3fff640 1 -- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fe4153b00 msgr2=0x7f9fe41f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.316+0000 7f9fe3fff640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fe4153b00 0x7f9fe41f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.316+0000 7f9fe3fff640 1 -- 172.21.15.46:0/2459750189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80094d0 con 0x7f9fe40ca600 2024-01-27T14:32:03.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.319+0000 7f9fe3fff640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009870 tx=0x7f9fd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.323+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8039a90 con 0x7f9fe40ca600 2024-01-27T14:32:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.323+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8039bf0 con 0x7f9fe40ca600 2024-01-27T14:32:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.323+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe4158840 con 0x7f9fe40ca600 2024-01-27T14:32:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.323+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80433f0 con 0x7f9fe40ca600 2024-01-27T14:32:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.323+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe4158dc0 con 0x7f9fe40ca600 2024-01-27T14:32:03.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.324+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe40742e0 con 0x7f9fe40ca600 2024-01-27T14:32:03.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.589+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9fd804c3b0 con 0x7f9fe40ca600 2024-01-27T14:32:03.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.589+0000 7f9fe0ff9640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 0x7f9fd006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:03.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.589+0000 7f9fe37fe640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 0x7f9fd006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:03.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.590+0000 7f9fe37fe640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 0x7f9fd006d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fe41e9700 tx=0x7f9fd4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:03.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.615+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fd807a8d0 con 0x7f9fe40ca600 2024-01-27T14:32:03.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.615+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9fd8076c10 con 0x7f9fe40ca600 2024-01-27T14:32:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.830+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9fe40cac90 con 0x7f9fe40ca600 2024-01-27T14:32:03.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.836+0000 7f9fe0ff9640 1 -- 172.21.15.46:0/2459750189 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9fd8034070 con 0x7f9fe40ca600 2024-01-27T14:32:03.832 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-27T14:32:03.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 msgr2=0x7f9fd006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 0x7f9fd006d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fe41e9700 tx=0x7f9fd4009190 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 msgr2=0x7f9fe41ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009870 tx=0x7f9fd8004730 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 shutdown_connections 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fd006af20 0x7f9fd006d3e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fe4153b00 0x7f9fe41f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fe40cf2c0 0x7f9fe40cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 --2- 172.21.15.46:0/2459750189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fe40ca600 0x7f9fe41ef840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 >> 172.21.15.46:0/2459750189 conn(0x7f9fe408b190 msgr2=0x7f9fe408b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 shutdown_connections 2024-01-27T14:32:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:03.838+0000 7f9fea69b640 1 -- 172.21.15.46:0/2459750189 wait complete. 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-27T14:32:03.845 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-27T14:32:03.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:03.845 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-27T14:32:03.860 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-27T14:32:03.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-27T14:32:03.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-27T14:32:03.862 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:04.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.034 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-27T14:32:04.059 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-27T14:32:04.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.061 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-27T14:32:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-27T14:32:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-27T14:32:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-27T14:32:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-27T14:32:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-27T14:32:04.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:04.132 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:04.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-27T14:32:04.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-27T14:32:04.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-27T14:32:04.133 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:04.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.395 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T14:32:04.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.410 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-27T14:32:04.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.464 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:04.464 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:04.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:04.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-27T14:32:04.465 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:04.548 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-27T14:32:04.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-27T14:32:04.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-27T14:32:04.549 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:04.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.689 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:04.689 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:04.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-27T14:32:04.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-27T14:32:04.689 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:04.730 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-27T14:32:04.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T14:32:04.731 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:04.788 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-27T14:32:04.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T14:32:04.789 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:04.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:04.910 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:04.965 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:04.965 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:04.965 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:04.965 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:04.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:04.968 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:05.019 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-27T14:32:05.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-27T14:32:05.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:05.088 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:05.144 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:05.144 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:05.145 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:05.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:05.147 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:05.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:2024-01-27T14:32:05.179+0000 7f6539a42480 -1 init, newargv = 0x55c73cc1b350 newargc=15 2024-01-27T14:32:05.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[43833]: starting ceph client 2024-01-27T14:32:05.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[43833]: starting fuse 2024-01-27T14:32:06.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:06.322 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:06.378 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:06.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:06.380 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:06.433 INFO:teuthology.orchestra.run.smithi046.stdout:42 2024-01-27T14:32:06.433 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-01-27T14:32:06.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-27T14:32:06.433 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-27T14:32:06.433 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-27T14:32:06.433 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-27T14:32:06.434 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-27T14:32:06.435 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-27T14:32:06.435 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-27T14:32:06.435 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:06.435 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.admin")) 2024-01-27T14:32:06.435 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-27T14:32:06.554 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.admin.43833.asok 2024-01-27T14:32:06.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-27T14:32:06.564 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43833.asok 2024-01-27T14:32:06.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:06.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43833.asok status 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "99a21c3b6c137f933ecc0074a260e59bd4ba2a7f", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-880-g99a21c3b (99a21c3b6c137f933ecc0074a260e59bd4ba2a7f) squid (dev)", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "admin", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "43833", 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-27T14:32:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4390, 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4390 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2066967203 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T14:32:06.702 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2066967203 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4390 172.21.15.46:0/2066967203", 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "172.21.15.46:0/2066967203", 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 7, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 27, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-27T14:32:06.703 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:06.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:06.709 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-27T14:32:06.709 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:06.735 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-27T14:32:06.735 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:06.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:06.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:06.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:06.870 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-27T14:32:07.074 INFO:teuthology.orchestra.run.smithi046.stdout:# file: . 2024-01-27T14:32:07.074 INFO:teuthology.orchestra.run.smithi046.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-27T14:32:07.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:07.074 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:32:07.074 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:32:07.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.235+0000 7f3e0cb53640 1 Processor -- start 2024-01-27T14:32:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.235+0000 7f3e0cb53640 1 -- start start 2024-01-27T14:32:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0cb53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e0814cd60 0x7f3e0806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0cb53640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e0806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0cb53640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e08072300 con 0x7f3e080c0000 2024-01-27T14:32:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0cb53640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e08156630 con 0x7f3e0814cd60 2024-01-27T14:32:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0cb53640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080c0440 con 0x7f3e0806d2b0 2024-01-27T14:32:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e06d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e0806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.236+0000 7f3e0659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e0814cd60 0x7f3e0806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.237+0000 7f3e06d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e0806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:40288/0 (socket says 172.21.15.46:40288) 2024-01-27T14:32:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.237+0000 7f3e06d9d640 1 -- 172.21.15.46:0/2873809555 learned_addr learned my addr 172.21.15.46:0/2873809555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.240+0000 7f3e0659c640 1 -- 172.21.15.46:0/2873809555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 msgr2=0x7f3e0806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.240+0000 7f3e0659c640 1 --2- 172.21.15.46:0/2873809555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e0806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.240+0000 7f3e0659c640 1 -- 172.21.15.46:0/2873809555 >> v1:172.21.15.46:6789/0 conn(0x7f3e080c0000 legacy=0x7f3e08156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.240+0000 7f3e0659c640 1 -- 172.21.15.46:0/2873809555 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e081571d0 con 0x7f3e0814cd60 2024-01-27T14:32:07.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.245+0000 7f3e0659c640 1 --2- 172.21.15.46:0/2873809555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e0806e010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009d90 tx=0x7f3df802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cd535352fedf3d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.252+0000 7f3e0559a640 1 -- 172.21.15.46:0/2873809555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df802cce0 con 0x7f3e0814cd60 2024-01-27T14:32:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.252+0000 7f3e0559a640 1 -- 172.21.15.46:0/2873809555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df802ce40 con 0x7f3e0814cd60 2024-01-27T14:32:07.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.252+0000 7f3e0559a640 1 -- 172.21.15.46:0/2873809555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8034660 con 0x7f3e0814cd60 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 -- 172.21.15.46:0/2873809555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 msgr2=0x7f3e0806e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/2873809555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e0806e010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009d90 tx=0x7f3df802bf30 comp rx=0 tx=0).stop 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 -- 172.21.15.46:0/2873809555 shutdown_connections 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/2873809555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e0806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/2873809555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e0806e010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 -- 172.21.15.46:0/2873809555 >> 172.21.15.46:0/2873809555 conn(0x7f3e080cafe0 msgr2=0x7f3e080cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 -- 172.21.15.46:0/2873809555 shutdown_connections 2024-01-27T14:32:07.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.253+0000 7f3e0cb53640 1 -- 172.21.15.46:0/2873809555 wait complete. 2024-01-27T14:32:07.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.254+0000 7f3e0cb53640 1 Processor -- start 2024-01-27T14:32:07.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.255+0000 7f3e0cb53640 1 -- start start 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.255+0000 7f3e0cb53640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e080c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.255+0000 7f3e0cb53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 0x7f3e08152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.255+0000 7f3e0cb53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e0cb53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081e24d0 con 0x7f3e0814cd60 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e0cb53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08153cc0 con 0x7f3e080c0000 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e0cb53640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080c95a0 con 0x7f3e0806d2b0 2024-01-27T14:32:07.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e06d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e05d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 0x7f3e08152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e0659c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e080c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e06d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37208/0 (socket says 172.21.15.46:37208) 2024-01-27T14:32:07.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.256+0000 7f3e06d9d640 1 -- 172.21.15.46:0/3004029481 learned_addr learned my addr 172.21.15.46:0/3004029481 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e05d9b640 1 -- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 msgr2=0x7f3e080c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e05d9b640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e080c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e05d9b640 1 -- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 msgr2=0x7f3e080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e05d9b640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e05d9b640 1 -- 172.21.15.46:0/3004029481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8009a70 con 0x7f3e080c0000 2024-01-27T14:32:07.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.260+0000 7f3e06d9d640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:07.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.262+0000 7f3e05d9b640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 0x7f3e08152520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c370 tx=0x7f3dfc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.265+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0052d0 con 0x7f3e080c0000 2024-01-27T14:32:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.266+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc005450 con 0x7f3e080c0000 2024-01-27T14:32:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.266+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e081e1430 con 0x7f3e080c0000 2024-01-27T14:32:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.266+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc007260 con 0x7f3e080c0000 2024-01-27T14:32:07.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.266+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e081e19f0 con 0x7f3e080c0000 2024-01-27T14:32:07.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.267+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0806e240 con 0x7f3e080c0000 2024-01-27T14:32:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.285+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3dfc0073c0 con 0x7f3e080c0000 2024-01-27T14:32:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.285+0000 7f3df6ffd640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 0x7f3de806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.285+0000 7f3e0659c640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 0x7f3de806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.286+0000 7f3e0659c640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 0x7f3de806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:07.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.513+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3dfc057d60 con 0x7f3e080c0000 2024-01-27T14:32:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.524+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3dfc0540a0 con 0x7f3e080c0000 2024-01-27T14:32:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.705+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e080742e0 con 0x7f3e080c0000 2024-01-27T14:32:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.742+0000 7f3df6ffd640 1 -- 172.21.15.46:0/3004029481 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f3dfc0576c0 con 0x7f3e080c0000 2024-01-27T14:32:07.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:07.739 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:58.317122+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:07.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.744+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 msgr2=0x7f3de806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.744+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 0x7f3de806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df8030000 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 msgr2=0x7f3e08152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 0x7f3e08152520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c370 tx=0x7f3dfc00c830 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 shutdown_connections 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3de806af50 0x7f3de806d410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e080c0000 0x7f3e08152520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e0814cd60 0x7f3e080711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 --2- 172.21.15.46:0/3004029481 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3e0806d2b0 0x7f3e080c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 >> 172.21.15.46:0/3004029481 conn(0x7f3e080cafe0 msgr2=0x7f3e08154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 shutdown_connections 2024-01-27T14:32:07.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.745+0000 7f3e0cb53640 1 -- 172.21.15.46:0/3004029481 wait complete. 2024-01-27T14:32:07.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:32:07.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:32:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.860+0000 7ff1e8d4c640 1 Processor -- start 2024-01-27T14:32:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.860+0000 7ff1e8d4c640 1 -- start start 2024-01-27T14:32:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.861+0000 7ff1e8d4c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e4153930 0x7ff1e40c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.861+0000 7ff1e8d4c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 0x7ff1e415d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.861+0000 7ff1e8d4c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e415cd50 con 0x7ff1e40ca340 2024-01-27T14:32:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.861+0000 7ff1e8d4c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e406d3f0 con 0x7ff1e4153930 2024-01-27T14:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.861+0000 7ff1e8d4c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c7c80 con 0x7ff1e415d200 2024-01-27T14:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.862+0000 7ff1e259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff1e4153930 0x7ff1e40c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.862+0000 7ff1e1d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1e40ca340 0x7ff1e4070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46824/0 (socket says 172.21.15.46:46824) 2024-01-27T14:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.862+0000 7ff1e1d9b640 1 -- 172.21.15.46:0/4208212720 learned_addr learned my addr 172.21.15.46:0/4208212720 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.862+0000 7ff1e2d9d640 1 --2- 172.21.15.46:0/4208212720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 0x7ff1e415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e159a640 1 -- 172.21.15.46:0/4208212720 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371460811 0 0) 0x7ff1e415cd50 con 0x7ff1e40ca340 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e159a640 1 -- 172.21.15.46:0/4208212720 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d0003520 con 0x7ff1e40ca340 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e2d9d640 1 -- 172.21.15.46:0/4208212720 >> v2:172.21.15.46:3300/0 conn(0x7ff1e4153930 msgr2=0x7ff1e40c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e2d9d640 1 --2- 172.21.15.46:0/4208212720 >> v2:172.21.15.46:3300/0 conn(0x7ff1e4153930 0x7ff1e40c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e2d9d640 1 -- 172.21.15.46:0/4208212720 >> v1:172.21.15.73:6789/0 conn(0x7ff1e40ca340 legacy=0x7ff1e4070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.864+0000 7ff1e2d9d640 1 -- 172.21.15.46:0/4208212720 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40c9580 con 0x7ff1e415d200 2024-01-27T14:32:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.866+0000 7ff1e2d9d640 1 --2- 172.21.15.46:0/4208212720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 0x7ff1e415d640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0097a0 tx=0x7ff1dc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de6af849080e04e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:07.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.872+0000 7ff1e159a640 1 -- 172.21.15.46:0/4208212720 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc030610 con 0x7ff1e415d200 2024-01-27T14:32:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.872+0000 7ff1e159a640 1 -- 172.21.15.46:0/4208212720 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc030770 con 0x7ff1e415d200 2024-01-27T14:32:07.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.872+0000 7ff1e159a640 1 -- 172.21.15.46:0/4208212720 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc030b00 con 0x7ff1e415d200 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/4208212720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 msgr2=0x7ff1e415d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/4208212720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 0x7ff1e415d640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0097a0 tx=0x7ff1dc02b960 comp rx=0 tx=0).stop 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/4208212720 shutdown_connections 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/4208212720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e415d200 0x7ff1e415d640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/4208212720 >> v2:172.21.15.46:3300/0 conn(0x7ff1e4153930 0x7ff1e40c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/4208212720 >> 172.21.15.46:0/4208212720 conn(0x7ff1e4066c80 msgr2=0x7ff1e406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/4208212720 shutdown_connections 2024-01-27T14:32:07.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.873+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/4208212720 wait complete. 2024-01-27T14:32:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.874+0000 7ff1e8d4c640 1 Processor -- start 2024-01-27T14:32:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.874+0000 7ff1e8d4c640 1 -- start start 2024-01-27T14:32:07.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 0x7ff1e41e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1e4153930 0x7ff1e41e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 0x7ff1e41efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41f01e0 con 0x7ff1e415d200 2024-01-27T14:32:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c5c80 con 0x7ff1e4153930 2024-01-27T14:32:07.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e8d4c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c5f00 con 0x7ff1e40ca340 2024-01-27T14:32:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.875+0000 7ff1e2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 0x7ff1e41efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.876+0000 7ff1e1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1e4153930 0x7ff1e41e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.876+0000 7ff1e259c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 0x7ff1e41e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.876+0000 7ff1e2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 0x7ff1e41efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37238/0 (socket says 172.21.15.46:37238) 2024-01-27T14:32:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.876+0000 7ff1e2d9d640 1 -- 172.21.15.46:0/3971080818 learned_addr learned my addr 172.21.15.46:0/3971080818 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.879+0000 7ff1e259c640 1 -- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1e4153930 msgr2=0x7ff1e41e61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.879+0000 7ff1e259c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1e4153930 0x7ff1e41e61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.879+0000 7ff1e259c640 1 -- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 msgr2=0x7ff1e41efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.879+0000 7ff1e259c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 0x7ff1e41efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.879+0000 7ff1e259c640 1 -- 172.21.15.46:0/3971080818 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc009400 con 0x7ff1e40ca340 2024-01-27T14:32:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.881+0000 7ff1e259c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 0x7ff1e41e2af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400efc0 tx=0x7ff1d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.885+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4014480 con 0x7ff1e40ca340 2024-01-27T14:32:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.885+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400f040 con 0x7ff1e40ca340 2024-01-27T14:32:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.885+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4014800 con 0x7ff1e40ca340 2024-01-27T14:32:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.885+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40c61e0 con 0x7ff1e40ca340 2024-01-27T14:32:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.885+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e41e59d0 con 0x7ff1e40ca340 2024-01-27T14:32:07.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.886+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40742e0 con 0x7ff1e40ca340 2024-01-27T14:32:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.905+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff1d4014960 con 0x7ff1e40ca340 2024-01-27T14:32:07.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.905+0000 7ff1daffd640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 0x7ff1c406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.905+0000 7ff1e1d9b640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 0x7ff1c406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:07.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:07.906+0000 7ff1e1d9b640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 0x7ff1c406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1e414f730 tx=0x7ff1cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:08.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.129+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1d4059560 con 0x7ff1e40ca340 2024-01-27T14:32:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.139+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff1d40558a0 con 0x7ff1e40ca340 2024-01-27T14:32:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.325+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1e40c6370 con 0x7ff1e40ca340 2024-01-27T14:32:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.346+0000 7ff1daffd640 1 -- 172.21.15.46:0/3971080818 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1d4058ec0 con 0x7ff1e40ca340 2024-01-27T14:32:08.343 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 msgr2=0x7ff1c406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 0x7ff1c406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1e414f730 tx=0x7ff1cc009040 comp rx=0 tx=0).stop 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 msgr2=0x7ff1e41e2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 0x7ff1e41e2af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400efc0 tx=0x7ff1d400c490 comp rx=0 tx=0).stop 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 shutdown_connections 2024-01-27T14:32:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff1c406af20 0x7ff1c406d3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1e4153930 0x7ff1e41e61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1e415d200 0x7ff1e41efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 --2- 172.21.15.46:0/3971080818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1e40ca340 0x7ff1e41e2af0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.348+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 >> 172.21.15.46:0/3971080818 conn(0x7ff1e4066c80 msgr2=0x7ff1e40c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.349+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 shutdown_connections 2024-01-27T14:32:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.349+0000 7ff1e8d4c640 1 -- 172.21.15.46:0/3971080818 wait complete. 2024-01-27T14:32:08.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:32:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.463+0000 7ff4ef42b640 1 Processor -- start 2024-01-27T14:32:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.463+0000 7ff4ef42b640 1 -- start start 2024-01-27T14:32:08.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.464+0000 7ff4ef42b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4e80ca340 0x7ff4e8070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.464+0000 7ff4ef42b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e815d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.464+0000 7ff4ef42b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e815cd50 con 0x7ff4e8153930 2024-01-27T14:32:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.464+0000 7ff4ef42b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e806d3f0 con 0x7ff4e80ca340 2024-01-27T14:32:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.464+0000 7ff4ef42b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e80c9580 con 0x7ff4e8071270 2024-01-27T14:32:08.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.465+0000 7ff4ed1c7640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff4e8153930 0x7ff4e80c7740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52086/0 (socket says 172.21.15.46:52086) 2024-01-27T14:32:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.465+0000 7ff4ed1c7640 1 -- 172.21.15.46:0/483048921 learned_addr learned my addr 172.21.15.46:0/483048921 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.465+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/483048921 >> v2:172.21.15.73:3300/0 conn(0x7ff4e80ca340 0x7ff4e8070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.465+0000 7ff4ed9c8640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.467+0000 7ff4e7fff640 1 -- 172.21.15.46:0/483048921 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284650848 0 0) 0x7ff4e815cd50 con 0x7ff4e8153930 2024-01-27T14:32:08.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.467+0000 7ff4e7fff640 1 -- 172.21.15.46:0/483048921 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d0003520 con 0x7ff4e8153930 2024-01-27T14:32:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.468+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 msgr2=0x7ff4e815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.468+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.468+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/483048921 >> v1:172.21.15.46:6789/0 conn(0x7ff4e8153930 legacy=0x7ff4e80c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.468+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/483048921 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8159a30 con 0x7ff4e80ca340 2024-01-27T14:32:08.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.470+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e8070d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0097a0 tx=0x7ff4dc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74dbc2b13c28dbec server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.473+0000 7ff4e7fff640 1 -- 172.21.15.46:0/483048921 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc030610 con 0x7ff4e80ca340 2024-01-27T14:32:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.473+0000 7ff4e7fff640 1 -- 172.21.15.46:0/483048921 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc030770 con 0x7ff4e80ca340 2024-01-27T14:32:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.473+0000 7ff4e7fff640 1 -- 172.21.15.46:0/483048921 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc030b00 con 0x7ff4e80ca340 2024-01-27T14:32:08.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 -- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 msgr2=0x7ff4e8070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e8070d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0097a0 tx=0x7ff4dc02b960 comp rx=0 tx=0).stop 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 -- 172.21.15.46:0/483048921 shutdown_connections 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/483048921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e8070d30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 -- 172.21.15.46:0/483048921 >> 172.21.15.46:0/483048921 conn(0x7ff4e8066c80 msgr2=0x7ff4e806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 -- 172.21.15.46:0/483048921 shutdown_connections 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.474+0000 7ff4ef42b640 1 -- 172.21.15.46:0/483048921 wait complete. 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.475+0000 7ff4ef42b640 1 Processor -- start 2024-01-27T14:32:08.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.475+0000 7ff4ef42b640 1 -- start start 2024-01-27T14:32:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e81e6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 0x7ff4e81e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81f3a30 con 0x7ff4e8153930 2024-01-27T14:32:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81f2b80 con 0x7ff4e80ca340 2024-01-27T14:32:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ef42b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81f2e20 con 0x7ff4e8071270 2024-01-27T14:32:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ed9c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 0x7ff4e81e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.476+0000 7ff4ec9c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.477+0000 7ff4ed1c7640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e81e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.477+0000 7ff4ec9c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41116/0 (socket says 172.21.15.46:41116) 2024-01-27T14:32:08.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.477+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/2693134171 learned_addr learned my addr 172.21.15.46:0/2693134171 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 msgr2=0x7ff4e81e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e81e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 msgr2=0x7ff4e81e5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 0x7ff4e81e5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ec9c6640 1 -- 172.21.15.46:0/2693134171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc009400 con 0x7ff4e80ca340 2024-01-27T14:32:08.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.480+0000 7ff4ed9c8640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 0x7ff4e81e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:08.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.483+0000 7ff4ec9c6640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc02bf70 tx=0x7ff4dc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.487+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc03e040 con 0x7ff4e80ca340 2024-01-27T14:32:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.487+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0399c0 con 0x7ff4e80ca340 2024-01-27T14:32:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.487+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e81f3100 con 0x7ff4e80ca340 2024-01-27T14:32:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.487+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc039d70 con 0x7ff4e80ca340 2024-01-27T14:32:08.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.487+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e81f36c0 con 0x7ff4e80ca340 2024-01-27T14:32:08.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.488+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e81f3880 con 0x7ff4e80ca340 2024-01-27T14:32:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.507+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff4dc04d3b0 con 0x7ff4e80ca340 2024-01-27T14:32:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.507+0000 7ff4e5ffb640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 0x7ff4d406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.508+0000 7ff4ed1c7640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 0x7ff4d406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.508+0000 7ff4ed1c7640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 0x7ff4d406d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005880 tx=0x7ff4e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.731+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4dc07a9e0 con 0x7ff4e80ca340 2024-01-27T14:32:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.740+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff4dc076d20 con 0x7ff4e80ca340 2024-01-27T14:32:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.923+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4e815dc50 con 0x7ff4e80ca340 2024-01-27T14:32:08.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.930+0000 7ff4e5ffb640 1 -- 172.21.15.46:0/2693134171 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4dc0490a0 con 0x7ff4e80ca340 2024-01-27T14:32:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 msgr2=0x7ff4d406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 0x7ff4d406d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005880 tx=0x7ff4e0009040 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 msgr2=0x7ff4e81e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc02bf70 tx=0x7ff4dc004730 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 shutdown_connections 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4d406af50 0x7ff4d406d410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4e80ca340 0x7ff4e81e5040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4e8153930 0x7ff4e81e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 --2- 172.21.15.46:0/2693134171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4e8071270 0x7ff4e81e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 >> 172.21.15.46:0/2693134171 conn(0x7ff4e8066c80 msgr2=0x7ff4e8158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 shutdown_connections 2024-01-27T14:32:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:08.932+0000 7ff4ef42b640 1 -- 172.21.15.46:0/2693134171 wait complete. 2024-01-27T14:32:08.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:32:09.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.047+0000 7f23bfe6b640 1 Processor -- start 2024-01-27T14:32:09.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.047+0000 7f23bfe6b640 1 -- start start 2024-01-27T14:32:09.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.048+0000 7f23bfe6b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f23b80710f0 0x7f23b80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.048+0000 7f23bfe6b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23b80714d0 0x7f23b815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.048+0000 7f23bfe6b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b80ca870 con 0x7f23b80c93b0 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.048+0000 7f23bfe6b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80c7ba0 con 0x7f23b80710f0 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.048+0000 7f23bfe6b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b8159a60 con 0x7f23b80714d0 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.049+0000 7f23bd406640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23b80714d0 0x7f23b815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.049+0000 7f23bdc07640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f23b80710f0 0x7f23b80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.049+0000 7f23bd406640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23b80714d0 0x7f23b815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41118/0 (socket says 172.21.15.46:41118) 2024-01-27T14:32:09.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.049+0000 7f23bd406640 1 -- 172.21.15.46:0/1689720381 learned_addr learned my addr 172.21.15.46:0/1689720381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.051+0000 7f23bd406640 1 -- 172.21.15.46:0/1689720381 >> v2:172.21.15.46:3300/0 conn(0x7f23b80710f0 msgr2=0x7f23b80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.051+0000 7f23bd406640 1 --2- 172.21.15.46:0/1689720381 >> v2:172.21.15.46:3300/0 conn(0x7f23b80710f0 0x7f23b80ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.051+0000 7f23bd406640 1 -- 172.21.15.46:0/1689720381 >> v1:172.21.15.46:6789/0 conn(0x7f23b80c93b0 legacy=0x7f23b8153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.051+0000 7f23bd406640 1 -- 172.21.15.46:0/1689720381 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8159d40 con 0x7f23b80714d0 2024-01-27T14:32:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.053+0000 7f23bd406640 1 --2- 172.21.15.46:0/1689720381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80714d0 0x7f23b815d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23b806ff70 tx=0x7f23ac02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a901e3c4d21c1ed9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bcc05640 1 -- 172.21.15.46:0/1689720381 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac02f850 con 0x7f23b80714d0 2024-01-27T14:32:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bcc05640 1 -- 172.21.15.46:0/1689720381 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac02f9b0 con 0x7f23b80714d0 2024-01-27T14:32:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bcc05640 1 -- 172.21.15.46:0/1689720381 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac02fd40 con 0x7f23b80714d0 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 -- 172.21.15.46:0/1689720381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80714d0 msgr2=0x7f23b815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/1689720381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80714d0 0x7f23b815d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23b806ff70 tx=0x7f23ac02ba30 comp rx=0 tx=0).stop 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 -- 172.21.15.46:0/1689720381 shutdown_connections 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/1689720381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80714d0 0x7f23b815d2c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/1689720381 >> v2:172.21.15.46:3300/0 conn(0x7f23b80710f0 0x7f23b80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 -- 172.21.15.46:0/1689720381 >> 172.21.15.46:0/1689720381 conn(0x7f23b8066ac0 msgr2=0x7f23b806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 -- 172.21.15.46:0/1689720381 shutdown_connections 2024-01-27T14:32:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.057+0000 7f23bfe6b640 1 -- 172.21.15.46:0/1689720381 wait complete. 2024-01-27T14:32:09.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 Processor -- start 2024-01-27T14:32:09.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 -- start start 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23b80710f0 0x7f23b81efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80c93b0 0x7f23b81f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b806bfe0 con 0x7f23b80714d0 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81f03c0 con 0x7f23b80c93b0 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.059+0000 7f23bfe6b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81f2b50 con 0x7f23b80710f0 2024-01-27T14:32:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.060+0000 7f23bd406640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.060+0000 7f23be408640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80c93b0 0x7f23b81f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.060+0000 7f23bd406640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37274/0 (socket says 172.21.15.46:37274) 2024-01-27T14:32:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.060+0000 7f23bd406640 1 -- 172.21.15.46:0/797548312 learned_addr learned my addr 172.21.15.46:0/797548312 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.060+0000 7f23bdc07640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23b80710f0 0x7f23b81efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.064+0000 7f23bd406640 1 -- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23b80710f0 msgr2=0x7f23b81efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.064+0000 7f23bd406640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23b80710f0 0x7f23b81efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.064+0000 7f23bd406640 1 -- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80c93b0 msgr2=0x7f23b81f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.064+0000 7f23bd406640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80c93b0 0x7f23b81f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.064+0000 7f23bd406640 1 -- 172.21.15.46:0/797548312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0094d0 con 0x7f23b80714d0 2024-01-27T14:32:09.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.066+0000 7f23bd406640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23ac02ba70 tx=0x7f23ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.069+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac037c40 con 0x7f23b80714d0 2024-01-27T14:32:09.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.069+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac037dc0 con 0x7f23b80714d0 2024-01-27T14:32:09.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.069+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac041640 con 0x7f23b80714d0 2024-01-27T14:32:09.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.070+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b80cba70 con 0x7f23b80714d0 2024-01-27T14:32:09.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.070+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b80cc030 con 0x7f23b80714d0 2024-01-27T14:32:09.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.071+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b80cc1c0 con 0x7f23b80714d0 2024-01-27T14:32:09.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.337+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f23ac0417a0 con 0x7f23b80714d0 2024-01-27T14:32:09.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.337+0000 7f23b67fc640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 0x7f23a406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.337+0000 7f23bdc07640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 0x7f23a406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.338+0000 7f23bdc07640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 0x7f23a406d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009b40 tx=0x7f23b0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.351+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23ac03c070 con 0x7f23b80714d0 2024-01-27T14:32:09.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.351+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f23ac077e10 con 0x7f23b80714d0 2024-01-27T14:32:09.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.538+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23b81f2d20 con 0x7f23b80714d0 2024-01-27T14:32:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.558+0000 7f23b67fc640 1 -- 172.21.15.46:0/797548312 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23ac07b430 con 0x7f23b80714d0 2024-01-27T14:32:09.554 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 msgr2=0x7f23a406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 0x7f23a406d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009b40 tx=0x7f23b0009190 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 msgr2=0x7f23b80c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23ac02ba70 tx=0x7f23ac004730 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 shutdown_connections 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f23a406af20 0x7f23a406d3e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23b80c93b0 0x7f23b81f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b80714d0 0x7f23b80c2510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 --2- 172.21.15.46:0/797548312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23b80710f0 0x7f23b81efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 >> 172.21.15.46:0/797548312 conn(0x7f23b8066ac0 msgr2=0x7f23b80c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 shutdown_connections 2024-01-27T14:32:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.560+0000 7f23bfe6b640 1 -- 172.21.15.46:0/797548312 wait complete. 2024-01-27T14:32:09.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:32:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.675+0000 7f734e82f640 1 Processor -- start 2024-01-27T14:32:09.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.675+0000 7f734e82f640 1 -- start start 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.676+0000 7f734e82f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7348153a20 0x7f73480ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.676+0000 7f734e82f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73480cc490 0x7f73480ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.676+0000 7f734e82f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734806bed0 con 0x7f734815a3c0 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.676+0000 7f734e82f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734806cdc0 con 0x7f73480cc490 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.676+0000 7f734e82f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734806c1b0 con 0x7f7348153a20 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.677+0000 7f7347fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7348153a20 0x7f73480ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.677+0000 7f734cdcc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73480cc490 0x7f73480ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.677+0000 7f73477fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f734815a3c0 0x7f73480cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52114/0 (socket says 172.21.15.46:52114) 2024-01-27T14:32:09.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.677+0000 7f73477fe640 1 -- 172.21.15.46:0/1597709243 learned_addr learned my addr 172.21.15.46:0/1597709243 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.679+0000 7f734cdcc640 1 -- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7348153a20 msgr2=0x7f73480ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.679+0000 7f734cdcc640 1 --2- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7348153a20 0x7f73480ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.679+0000 7f734cdcc640 1 -- 172.21.15.46:0/1597709243 >> v1:172.21.15.46:6789/0 conn(0x7f734815a3c0 legacy=0x7f73480cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.679+0000 7f734cdcc640 1 -- 172.21.15.46:0/1597709243 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734806c490 con 0x7f73480cc490 2024-01-27T14:32:09.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.681+0000 7f734cdcc640 1 --2- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480cc490 0x7f73480ca590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7340009d90 tx=0x7f734002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a68c1af9d661e27 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f7346ffd640 1 -- 172.21.15.46:0/1597709243 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734002cce0 con 0x7f73480cc490 2024-01-27T14:32:09.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f7346ffd640 1 -- 172.21.15.46:0/1597709243 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734002ce40 con 0x7f73480cc490 2024-01-27T14:32:09.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f7346ffd640 1 -- 172.21.15.46:0/1597709243 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340034660 con 0x7f73480cc490 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 -- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480cc490 msgr2=0x7f73480ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 --2- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480cc490 0x7f73480ca590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7340009d90 tx=0x7f734002bf30 comp rx=0 tx=0).stop 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 -- 172.21.15.46:0/1597709243 shutdown_connections 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 --2- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480cc490 0x7f73480ca590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 --2- 172.21.15.46:0/1597709243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7348153a20 0x7f73480ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 -- 172.21.15.46:0/1597709243 >> 172.21.15.46:0/1597709243 conn(0x7f7348071fd0 msgr2=0x7f73480723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 -- 172.21.15.46:0/1597709243 shutdown_connections 2024-01-27T14:32:09.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.685+0000 7f734e82f640 1 -- 172.21.15.46:0/1597709243 wait complete. 2024-01-27T14:32:09.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.686+0000 7f734e82f640 1 Processor -- start 2024-01-27T14:32:09.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 -- start start 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73480cc490 0x7f734815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f734815a3c0 0x7f734815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c8940 con 0x7f73480cc490 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734815aa70 con 0x7f7348153a20 2024-01-27T14:32:09.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.687+0000 7f734e82f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734815d8e0 con 0x7f734815a3c0 2024-01-27T14:32:09.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.688+0000 7f7347fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73480cc490 0x7f734815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.688+0000 7f73477fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.688+0000 7f734cdcc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f734815a3c0 0x7f734815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.688+0000 7f73477fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41154/0 (socket says 172.21.15.46:41154) 2024-01-27T14:32:09.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.688+0000 7f73477fe640 1 -- 172.21.15.46:0/2691496650 learned_addr learned my addr 172.21.15.46:0/2691496650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:09.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.691+0000 7f73477fe640 1 -- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f734815a3c0 msgr2=0x7f734815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.691+0000 7f73477fe640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f734815a3c0 0x7f734815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.691+0000 7f73477fe640 1 -- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73480cc490 msgr2=0x7f734815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:09.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.691+0000 7f73477fe640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73480cc490 0x7f734815c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:09.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.691+0000 7f73477fe640 1 -- 172.21.15.46:0/2691496650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009a70 con 0x7f7348153a20 2024-01-27T14:32:09.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.693+0000 7f73477fe640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c3c0 tx=0x7f733c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.697+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c005ce0 con 0x7f7348153a20 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.697+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c005e40 con 0x7f7348153a20 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.697+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7348153f80 con 0x7f7348153a20 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.697+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0072d0 con 0x7f7348153a20 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.697+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480c8e10 con 0x7f7348153a20 2024-01-27T14:32:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.698+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7348068280 con 0x7f7348153a20 2024-01-27T14:32:09.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.718+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f733c0074f0 con 0x7f7348153a20 2024-01-27T14:32:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.718+0000 7f7344ff9640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 0x7f733406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.718+0000 7f7347fff640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 0x7f733406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.719+0000 7f7347fff640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 0x7f733406d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7338009b40 tx=0x7f7338009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:09.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.942+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f733c057be0 con 0x7f7348153a20 2024-01-27T14:32:09.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:09.953+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f733c053f20 con 0x7f7348153a20 2024-01-27T14:32:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.135+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f73480742e0 con 0x7f7348153a20 2024-01-27T14:32:10.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.141+0000 7f7344ff9640 1 -- 172.21.15.46:0/2691496650 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f733c017020 con 0x7f7348153a20 2024-01-27T14:32:10.137 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 msgr2=0x7f733406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 0x7f733406d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7338009b40 tx=0x7f7338009190 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 msgr2=0x7f73481e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c3c0 tx=0x7f733c00c880 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 shutdown_connections 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f733406af20 0x7f733406d3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7348153a20 0x7f73481e49a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f734815a3c0 0x7f734815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 --2- 172.21.15.46:0/2691496650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73480cc490 0x7f734815c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 >> 172.21.15.46:0/2691496650 conn(0x7f7348071fd0 msgr2=0x7f73481596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 shutdown_connections 2024-01-27T14:32:10.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.143+0000 7f734e82f640 1 -- 172.21.15.46:0/2691496650 wait complete. 2024-01-27T14:32:10.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:32:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.256+0000 7f4e1be75640 1 Processor -- start 2024-01-27T14:32:10.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.256+0000 7f4e1be75640 1 -- start start 2024-01-27T14:32:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.257+0000 7f4e1be75640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 0x7f4e140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.257+0000 7f4e1be75640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e140714d0 0x7f4e1415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.257+0000 7f4e1be75640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140ca870 con 0x7f4e140c93b0 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.257+0000 7f4e1be75640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140c7ba0 con 0x7f4e140714d0 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.257+0000 7f4e1be75640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14159a60 con 0x7f4e140710f0 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.258+0000 7f4e19c11640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 0x7f4e140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.258+0000 7f4e19410640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e140714d0 0x7f4e1415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.258+0000 7f4e1a412640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4e140c93b0 0x7f4e14153580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46828/0 (socket says 172.21.15.46:46828) 2024-01-27T14:32:10.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.258+0000 7f4e1a412640 1 -- 172.21.15.46:0/1431503881 learned_addr learned my addr 172.21.15.46:0/1431503881 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.261+0000 7f4e19c11640 1 -- 172.21.15.46:0/1431503881 >> v2:172.21.15.73:3300/0 conn(0x7f4e140714d0 msgr2=0x7f4e1415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.261+0000 7f4e19c11640 1 --2- 172.21.15.46:0/1431503881 >> v2:172.21.15.73:3300/0 conn(0x7f4e140714d0 0x7f4e1415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.261+0000 7f4e19c11640 1 -- 172.21.15.46:0/1431503881 >> v1:172.21.15.73:6789/0 conn(0x7f4e140c93b0 legacy=0x7f4e14153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.261+0000 7f4e19c11640 1 -- 172.21.15.46:0/1431503881 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14159d40 con 0x7f4e140710f0 2024-01-27T14:32:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.263+0000 7f4e19c11640 1 --2- 172.21.15.46:0/1431503881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 0x7f4e140ca330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e100097a0 tx=0x7f4e1002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961496296acd09fc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.267+0000 7f4e18c0f640 1 -- 172.21.15.46:0/1431503881 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10030610 con 0x7f4e140710f0 2024-01-27T14:32:10.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.267+0000 7f4e18c0f640 1 -- 172.21.15.46:0/1431503881 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10030770 con 0x7f4e140710f0 2024-01-27T14:32:10.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.267+0000 7f4e18c0f640 1 -- 172.21.15.46:0/1431503881 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10030b00 con 0x7f4e140710f0 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 -- 172.21.15.46:0/1431503881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 msgr2=0x7f4e140ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 --2- 172.21.15.46:0/1431503881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 0x7f4e140ca330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e100097a0 tx=0x7f4e1002b960 comp rx=0 tx=0).stop 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 -- 172.21.15.46:0/1431503881 shutdown_connections 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 --2- 172.21.15.46:0/1431503881 >> v2:172.21.15.73:3300/0 conn(0x7f4e140714d0 0x7f4e1415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 --2- 172.21.15.46:0/1431503881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140710f0 0x7f4e140ca330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 -- 172.21.15.46:0/1431503881 >> 172.21.15.46:0/1431503881 conn(0x7f4e14066ac0 msgr2=0x7f4e1406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 -- 172.21.15.46:0/1431503881 shutdown_connections 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.268+0000 7f4e1be75640 1 -- 172.21.15.46:0/1431503881 wait complete. 2024-01-27T14:32:10.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.269+0000 7f4e1be75640 1 Processor -- start 2024-01-27T14:32:10.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.269+0000 7f4e1be75640 1 -- start start 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 0x7f4e140c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140c93b0 0x7f4e141f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c7190 con 0x7f4e140710f0 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141ef180 con 0x7f4e140714d0 2024-01-27T14:32:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1be75640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c56c0 con 0x7f4e140c93b0 2024-01-27T14:32:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e19c11640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 0x7f4e140c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e19410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e1a412640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140c93b0 0x7f4e141f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e19410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41174/0 (socket says 172.21.15.46:41174) 2024-01-27T14:32:10.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.270+0000 7f4e19410640 1 -- 172.21.15.46:0/2060798675 learned_addr learned my addr 172.21.15.46:0/2060798675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:10.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19410640 1 -- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140c93b0 msgr2=0x7f4e141f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19410640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140c93b0 0x7f4e141f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19410640 1 -- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 msgr2=0x7f4e140c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19410640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 0x7f4e140c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19410640 1 -- 172.21.15.46:0/2060798675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009400 con 0x7f4e140714d0 2024-01-27T14:32:10.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.274+0000 7f4e19c11640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 0x7f4e140c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:10.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.276+0000 7f4e19410640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400e9b0 tx=0x7f4e0400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.280+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04009670 con 0x7f4e140714d0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.280+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400c9a0 con 0x7f4e140714d0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.280+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400cd50 con 0x7f4e140714d0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.280+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140c6bd0 con 0x7f4e140714d0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.280+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e141f2890 con 0x7f4e140714d0 2024-01-27T14:32:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.281+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e141f26f0 con 0x7f4e140714d0 2024-01-27T14:32:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.301+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4e04013470 con 0x7f4e140714d0 2024-01-27T14:32:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.301+0000 7f4e0a7fc640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 0x7f4df806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.301+0000 7f4e19c11640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 0x7f4df806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.301+0000 7f4e19c11640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 0x7f4df806d3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e10036000 tx=0x7f4e10008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.528+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e04058a50 con 0x7f4e140714d0 2024-01-27T14:32:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.538+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4e04054d90 con 0x7f4e140714d0 2024-01-27T14:32:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.732+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e141f26f0 con 0x7f4e140714d0 2024-01-27T14:32:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.736+0000 7f4e0a7fc640 1 -- 172.21.15.46:0/2060798675 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4e141f26f0 con 0x7f4e140714d0 2024-01-27T14:32:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 msgr2=0x7f4df806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 0x7f4df806d3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e10036000 tx=0x7f4e10008030 comp rx=0 tx=0).stop 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 msgr2=0x7f4e141535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400e9b0 tx=0x7f4e0400ee70 comp rx=0 tx=0).stop 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 shutdown_connections 2024-01-27T14:32:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4df806af20 0x7f4df806d3e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e140714d0 0x7f4e141535c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e140c93b0 0x7f4e141f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 --2- 172.21.15.46:0/2060798675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e140710f0 0x7f4e140c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 >> 172.21.15.46:0/2060798675 conn(0x7f4e14066ac0 msgr2=0x7f4e141e4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 shutdown_connections 2024-01-27T14:32:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.738+0000 7f4e1be75640 1 -- 172.21.15.46:0/2060798675 wait complete. 2024-01-27T14:32:10.745 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:32:10.745 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:32:10.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.906+0000 7f985a0b4640 1 Processor -- start 2024-01-27T14:32:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.906+0000 7f985a0b4640 1 -- start start 2024-01-27T14:32:10.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.907+0000 7f985a0b4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98540cf2c0 0x7f98540ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.907+0000 7f985a0b4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98540b3280 con 0x7f98540ca600 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.907+0000 7f985a0b4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985415d0d0 con 0x7f9854153b00 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.907+0000 7f985a0b4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985415a8a0 con 0x7f98540cf2c0 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.908+0000 7f9853fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f98540ca600 0x7f98540b3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52128/0 (socket says 172.21.15.46:52128) 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.908+0000 7f9853fff640 1 -- 172.21.15.46:0/2372777983 learned_addr learned my addr 172.21.15.46:0/2372777983 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.908+0000 7f9852ffd640 1 --2- 172.21.15.46:0/2372777983 >> v2:172.21.15.73:3300/0 conn(0x7f98540cf2c0 0x7f98540ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.910+0000 7f98527fc640 1 -- 172.21.15.46:0/2372777983 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051781504 0 0) 0x7f98540b3280 con 0x7f98540ca600 2024-01-27T14:32:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.910+0000 7f98527fc640 1 -- 172.21.15.46:0/2372777983 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f983c003520 con 0x7f98540ca600 2024-01-27T14:32:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.911+0000 7f9852ffd640 1 -- 172.21.15.46:0/2372777983 >> v1:172.21.15.73:6789/0 conn(0x7f9854153b00 legacy=0x7f98540cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.911+0000 7f9852ffd640 1 -- 172.21.15.46:0/2372777983 >> v1:172.21.15.46:6789/0 conn(0x7f98540ca600 legacy=0x7f98540b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.911+0000 7f9852ffd640 1 -- 172.21.15.46:0/2372777983 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985415ce00 con 0x7f98540cf2c0 2024-01-27T14:32:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.913+0000 7f9852ffd640 1 --2- 172.21.15.46:0/2372777983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540ca0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98480097d0 tx=0x7f984802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ababa9e877ad373 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f98527fc640 1 -- 172.21.15.46:0/2372777983 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848030610 con 0x7f98540cf2c0 2024-01-27T14:32:10.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f98527fc640 1 -- 172.21.15.46:0/2372777983 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848030770 con 0x7f98540cf2c0 2024-01-27T14:32:10.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f98527fc640 1 -- 172.21.15.46:0/2372777983 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848030b00 con 0x7f98540cf2c0 2024-01-27T14:32:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 -- 172.21.15.46:0/2372777983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 msgr2=0x7f98540ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 --2- 172.21.15.46:0/2372777983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540ca0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98480097d0 tx=0x7f984802b960 comp rx=0 tx=0).stop 2024-01-27T14:32:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 -- 172.21.15.46:0/2372777983 shutdown_connections 2024-01-27T14:32:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 --2- 172.21.15.46:0/2372777983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540ca0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 -- 172.21.15.46:0/2372777983 >> 172.21.15.46:0/2372777983 conn(0x7f985408b190 msgr2=0x7f985408b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:10.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 -- 172.21.15.46:0/2372777983 shutdown_connections 2024-01-27T14:32:10.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.918+0000 7f985a0b4640 1 -- 172.21.15.46:0/2372777983 wait complete. 2024-01-27T14:32:10.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.920+0000 7f985a0b4640 1 Processor -- start 2024-01-27T14:32:10.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.920+0000 7f985a0b4640 1 -- start start 2024-01-27T14:32:10.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.920+0000 7f985a0b4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98540ca600 0x7f9854156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.920+0000 7f985a0b4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.920+0000 7f985a0b4640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9854153b00 0x7f98541ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f985a0b4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98540caa10 con 0x7f98540ca600 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f985a0b4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9854154e30 con 0x7f98540cf2c0 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f985a0b4640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98541ef060 con 0x7f9854153b00 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f98537fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98540ca600 0x7f9854156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f9853fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9854153b00 0x7f98541ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41192/0 (socket says 172.21.15.46:41192) 2024-01-27T14:32:10.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.921+0000 7f9852ffd640 1 -- 172.21.15.46:0/1687799431 learned_addr learned my addr 172.21.15.46:0/1687799431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:10.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.925+0000 7f9852ffd640 1 -- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9854153b00 msgr2=0x7f98541ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.925+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9854153b00 0x7f98541ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.925+0000 7f9852ffd640 1 -- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98540ca600 msgr2=0x7f9854156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:10.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.925+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98540ca600 0x7f9854156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:10.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.925+0000 7f9852ffd640 1 -- 172.21.15.46:0/1687799431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848009400 con 0x7f98540cf2c0 2024-01-27T14:32:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.927+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98480098f0 tx=0x7f9848004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.930+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984803e040 con 0x7f98540cf2c0 2024-01-27T14:32:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.930+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848039cb0 con 0x7f98540cf2c0 2024-01-27T14:32:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.930+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848044630 con 0x7f98540cf2c0 2024-01-27T14:32:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.930+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98541592f0 con 0x7f98540cf2c0 2024-01-27T14:32:10.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.931+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9854158720 con 0x7f98540cf2c0 2024-01-27T14:32:10.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.931+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98540742e0 con 0x7f98540cf2c0 2024-01-27T14:32:10.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.951+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f984804d3b0 con 0x7f98540cf2c0 2024-01-27T14:32:10.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.952+0000 7f983bfff640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 0x7f984006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:10.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.952+0000 7f98537fe640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 0x7f984006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:10.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.952+0000 7f98537fe640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 0x7f984006d410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:10.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:10.953+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9848039e20 con 0x7f98540cf2c0 2024-01-27T14:32:11.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.190+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9848076ec0 con 0x7f98540cf2c0 2024-01-27T14:32:11.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.375+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98540cac90 con 0x7f98540cf2c0 2024-01-27T14:32:11.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.411+0000 7f983bfff640 1 -- 172.21.15.46:0/1687799431 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f9848034090 con 0x7f98540cf2c0 2024-01-27T14:32:11.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:11.409 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:31:58.317122+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:11.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 msgr2=0x7f984006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 0x7f984006d410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844009060 comp rx=0 tx=0).stop 2024-01-27T14:32:11.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 msgr2=0x7f98540c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98480098f0 tx=0x7f9848004730 comp rx=0 tx=0).stop 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 shutdown_connections 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984006af50 0x7f984006d410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98540cf2c0 0x7f98540c52c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.413+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9854153b00 0x7f98541ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.414+0000 7f985a0b4640 1 --2- 172.21.15.46:0/1687799431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98540ca600 0x7f9854156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.414+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 >> 172.21.15.46:0/1687799431 conn(0x7f985408b190 msgr2=0x7f98540b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.414+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 shutdown_connections 2024-01-27T14:32:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.414+0000 7f985a0b4640 1 -- 172.21.15.46:0/1687799431 wait complete. 2024-01-27T14:32:11.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:32:11.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:32:11.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.529+0000 7fc9395f1640 1 Processor -- start 2024-01-27T14:32:11.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.529+0000 7fc9395f1640 1 -- start start 2024-01-27T14:32:11.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9395f1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 0x7fc9340ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9395f1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9340cc490 0x7fc9340ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9395f1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93406bed0 con 0x7fc93415a3c0 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9395f1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93406cdc0 con 0x7fc9340cc490 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9395f1640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93406c1b0 con 0x7fc934153a20 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc932ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 0x7fc9340ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9337fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9340cc490 0x7fc9340ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9327fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc93415a3c0 0x7fc9340cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52144/0 (socket says 172.21.15.46:52144) 2024-01-27T14:32:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.530+0000 7fc9327fc640 1 -- 172.21.15.46:0/2312700082 learned_addr learned my addr 172.21.15.46:0/2312700082 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.533+0000 7fc932ffd640 1 -- 172.21.15.46:0/2312700082 >> v2:172.21.15.73:3300/0 conn(0x7fc9340cc490 msgr2=0x7fc9340ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.533+0000 7fc932ffd640 1 --2- 172.21.15.46:0/2312700082 >> v2:172.21.15.73:3300/0 conn(0x7fc9340cc490 0x7fc9340ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.533+0000 7fc932ffd640 1 -- 172.21.15.46:0/2312700082 >> v1:172.21.15.46:6789/0 conn(0x7fc93415a3c0 legacy=0x7fc9340cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.533+0000 7fc932ffd640 1 -- 172.21.15.46:0/2312700082 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93406c490 con 0x7fc934153a20 2024-01-27T14:32:11.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.535+0000 7fc932ffd640 1 --2- 172.21.15.46:0/2312700082 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 0x7fc9340ca050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac7ca545a4b0d3b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.538+0000 7fc931ffb640 1 -- 172.21.15.46:0/2312700082 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c030610 con 0x7fc934153a20 2024-01-27T14:32:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.538+0000 7fc931ffb640 1 -- 172.21.15.46:0/2312700082 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c030770 con 0x7fc934153a20 2024-01-27T14:32:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.538+0000 7fc931ffb640 1 -- 172.21.15.46:0/2312700082 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c030b00 con 0x7fc934153a20 2024-01-27T14:32:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 -- 172.21.15.46:0/2312700082 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 msgr2=0x7fc9340ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 --2- 172.21.15.46:0/2312700082 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 0x7fc9340ca050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02b960 comp rx=0 tx=0).stop 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 -- 172.21.15.46:0/2312700082 shutdown_connections 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 --2- 172.21.15.46:0/2312700082 >> v2:172.21.15.73:3300/0 conn(0x7fc9340cc490 0x7fc9340ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 --2- 172.21.15.46:0/2312700082 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc934153a20 0x7fc9340ca050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 -- 172.21.15.46:0/2312700082 >> 172.21.15.46:0/2312700082 conn(0x7fc934071fd0 msgr2=0x7fc9340723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 -- 172.21.15.46:0/2312700082 shutdown_connections 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.539+0000 7fc9395f1640 1 -- 172.21.15.46:0/2312700082 wait complete. 2024-01-27T14:32:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.540+0000 7fc9395f1640 1 Processor -- start 2024-01-27T14:32:11.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.540+0000 7fc9395f1640 1 -- start start 2024-01-27T14:32:11.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 0x7fc9340cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc93415a3c0 0x7fc9340c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340cef90 con 0x7fc93415a3c0 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340ce550 con 0x7fc934153a20 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9395f1640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340c6eb0 con 0x7fc9340cc490 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc9337fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc93415a3c0 0x7fc9340c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.541+0000 7fc932ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 0x7fc9340cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.542+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.542+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41214/0 (socket says 172.21.15.46:41214) 2024-01-27T14:32:11.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.542+0000 7fc9327fc640 1 -- 172.21.15.46:0/619401343 learned_addr learned my addr 172.21.15.46:0/619401343 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:11.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc932ffd640 1 -- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 msgr2=0x7fc934149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc932ffd640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc932ffd640 1 -- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc93415a3c0 msgr2=0x7fc9340c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:11.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc932ffd640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc93415a3c0 0x7fc9340c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:11.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc932ffd640 1 -- 172.21.15.46:0/619401343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009400 con 0x7fc9340cc490 2024-01-27T14:32:11.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.545+0000 7fc9327fc640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:11.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.547+0000 7fc932ffd640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 0x7fc9340cf700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc92c033000 tx=0x7fc92c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.551+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c03e040 con 0x7fc9340cc490 2024-01-27T14:32:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.551+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c039cb0 con 0x7fc9340cc490 2024-01-27T14:32:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.551+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc934153f80 con 0x7fc9340cc490 2024-01-27T14:32:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.551+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c044630 con 0x7fc9340cc490 2024-01-27T14:32:11.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.552+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9340ce8d0 con 0x7fc9340cc490 2024-01-27T14:32:11.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.552+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340742e0 con 0x7fc9340cc490 2024-01-27T14:32:11.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.795+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc92c04d3b0 con 0x7fc9340cc490 2024-01-27T14:32:11.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.795+0000 7fc92b7fe640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 0x7fc91406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:11.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.796+0000 7fc9327fc640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 0x7fc91406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:11.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.796+0000 7fc9327fc640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 0x7fc91406d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9340cdb90 tx=0x7fc91c007f10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:11.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.801+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc92c039e20 con 0x7fc9340cc490 2024-01-27T14:32:11.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:11.813+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc92c076e30 con 0x7fc9340cc490 2024-01-27T14:32:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.019+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9340cb290 con 0x7fc9340cc490 2024-01-27T14:32:12.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.026+0000 7fc92b7fe640 1 -- 172.21.15.46:0/619401343 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc92c0490a0 con 0x7fc9340cc490 2024-01-27T14:32:12.023 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 msgr2=0x7fc91406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 0x7fc91406d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9340cdb90 tx=0x7fc91c007f10 comp rx=0 tx=0).stop 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 msgr2=0x7fc9340cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 0x7fc9340cf700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc92c033000 tx=0x7fc92c004730 comp rx=0 tx=0).stop 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 shutdown_connections 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc91406af50 0x7fc91406d410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc934153a20 0x7fc934149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc93415a3c0 0x7fc9340c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 --2- 172.21.15.46:0/619401343 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9340cc490 0x7fc9340cf700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 >> 172.21.15.46:0/619401343 conn(0x7fc934071fd0 msgr2=0x7fc93414ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 shutdown_connections 2024-01-27T14:32:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.028+0000 7fc9395f1640 1 -- 172.21.15.46:0/619401343 wait complete. 2024-01-27T14:32:12.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:32:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.143+0000 7f0ae2ee5640 1 Processor -- start 2024-01-27T14:32:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 -- start start 2024-01-27T14:32:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0adc0ca340 0x7f0adc070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc15cd50 con 0x7f0adc071270 2024-01-27T14:32:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc06d3f0 con 0x7f0adc0ca340 2024-01-27T14:32:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.144+0000 7f0ae2ee5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c7c80 con 0x7f0adc153930 2024-01-27T14:32:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.145+0000 7f0ae0c81640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.145+0000 7f0ae1482640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0adc071270 0x7f0adc15d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46840/0 (socket says 172.21.15.46:46840) 2024-01-27T14:32:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.145+0000 7f0ae1482640 1 -- 172.21.15.46:0/2528947157 learned_addr learned my addr 172.21.15.46:0/2528947157 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.145+0000 7f0adbfff640 1 --2- 172.21.15.46:0/2528947157 >> v2:172.21.15.73:3300/0 conn(0x7f0adc0ca340 0x7f0adc070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.148+0000 7f0ae0c81640 1 -- 172.21.15.46:0/2528947157 >> v2:172.21.15.73:3300/0 conn(0x7f0adc0ca340 msgr2=0x7f0adc070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.148+0000 7f0ae0c81640 1 --2- 172.21.15.46:0/2528947157 >> v2:172.21.15.73:3300/0 conn(0x7f0adc0ca340 0x7f0adc070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.148+0000 7f0ae0c81640 1 -- 172.21.15.46:0/2528947157 >> v1:172.21.15.73:6789/0 conn(0x7f0adc071270 legacy=0x7f0adc15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.148+0000 7f0ae0c81640 1 -- 172.21.15.46:0/2528947157 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0c9580 con 0x7f0adc153930 2024-01-27T14:32:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.150+0000 7f0ae0c81640 1 --2- 172.21.15.46:0/2528947157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc0c7740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00097a0 tx=0x7f0ad002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b247999e2c5105bb server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0adb7fe640 1 -- 172.21.15.46:0/2528947157 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0030610 con 0x7f0adc153930 2024-01-27T14:32:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0adb7fe640 1 -- 172.21.15.46:0/2528947157 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0030770 con 0x7f0adc153930 2024-01-27T14:32:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0adb7fe640 1 -- 172.21.15.46:0/2528947157 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0030b00 con 0x7f0adc153930 2024-01-27T14:32:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/2528947157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 msgr2=0x7f0adc0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/2528947157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc0c7740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00097a0 tx=0x7f0ad002b960 comp rx=0 tx=0).stop 2024-01-27T14:32:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/2528947157 shutdown_connections 2024-01-27T14:32:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/2528947157 >> v2:172.21.15.73:3300/0 conn(0x7f0adc0ca340 0x7f0adc070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/2528947157 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc0c7740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.153+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/2528947157 >> 172.21.15.46:0/2528947157 conn(0x7f0adc066c80 msgr2=0x7f0adc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.154+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/2528947157 shutdown_connections 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.154+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/2528947157 wait complete. 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 Processor -- start 2024-01-27T14:32:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 -- start start 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0adc071270 0x7f0adc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc1f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0cc6e0 con 0x7f0adc071270 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0ccc30 con 0x7f0adc0ca340 2024-01-27T14:32:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.155+0000 7f0ae2ee5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1f3770 con 0x7f0adc153930 2024-01-27T14:32:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.156+0000 7f0ae0c81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0adc071270 0x7f0adc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.156+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.156+0000 7f0ae1482640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc1f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.156+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41232/0 (socket says 172.21.15.46:41232) 2024-01-27T14:32:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.156+0000 7f0adbfff640 1 -- 172.21.15.46:0/3915174204 learned_addr learned my addr 172.21.15.46:0/3915174204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.160+0000 7f0adbfff640 1 -- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 msgr2=0x7f0adc1f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.160+0000 7f0adbfff640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc1f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.160+0000 7f0adbfff640 1 -- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0adc071270 msgr2=0x7f0adc0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.160+0000 7f0adbfff640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0adc071270 0x7f0adc0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.160+0000 7f0adbfff640 1 -- 172.21.15.46:0/3915174204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009400 con 0x7f0adc0ca340 2024-01-27T14:32:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.163+0000 7f0adbfff640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800ea10 tx=0x7f0ac800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.166+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8009670 con 0x7f0adc0ca340 2024-01-27T14:32:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.166+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800ca00 con 0x7f0adc0ca340 2024-01-27T14:32:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.166+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc151060 con 0x7f0adc0ca340 2024-01-27T14:32:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.166+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800cdb0 con 0x7f0adc0ca340 2024-01-27T14:32:12.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.166+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc1515e0 con 0x7f0adc0ca340 2024-01-27T14:32:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.167+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc1517d0 con 0x7f0adc0ca340 2024-01-27T14:32:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.407+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0ac8013470 con 0x7f0adc0ca340 2024-01-27T14:32:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.408+0000 7f0ad97fa640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 0x7f0ac006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.408+0000 7f0ae0c81640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 0x7f0ac006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.408+0000 7f0ae0c81640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 0x7f0ac006d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0036000 tx=0x7f0ad003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.411+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ac8058bf0 con 0x7f0adc0ca340 2024-01-27T14:32:12.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.420+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0ac8054f30 con 0x7f0adc0ca340 2024-01-27T14:32:12.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.598+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0adc0742e0 con 0x7f0adc0ca340 2024-01-27T14:32:12.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.604+0000 7f0ad97fa640 1 -- 172.21.15.46:0/3915174204 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ac80170a0 con 0x7f0adc0ca340 2024-01-27T14:32:12.600 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.605+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 msgr2=0x7f0ac006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.605+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 0x7f0ac006d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0036000 tx=0x7f0ad003b040 comp rx=0 tx=0).stop 2024-01-27T14:32:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.605+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 msgr2=0x7f0adc1f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.605+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800ea10 tx=0x7f0ac800eed0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 shutdown_connections 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0ac006af20 0x7f0ac006d3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0adc0ca340 0x7f0adc1f2cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0adc153930 0x7f0adc1f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 --2- 172.21.15.46:0/3915174204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0adc071270 0x7f0adc0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 >> 172.21.15.46:0/3915174204 conn(0x7f0adc066c80 msgr2=0x7f0adc151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 shutdown_connections 2024-01-27T14:32:12.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.606+0000 7f0ae2ee5640 1 -- 172.21.15.46:0/3915174204 wait complete. 2024-01-27T14:32:12.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:32:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.724+0000 7fce4ee9b640 1 Processor -- start 2024-01-27T14:32:12.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.724+0000 7fce4ee9b640 1 -- start start 2024-01-27T14:32:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.725+0000 7fce4ee9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce480c8640 0x7fce480c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.725+0000 7fce4ee9b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480bff20 con 0x7fce480c6310 2024-01-27T14:32:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.725+0000 7fce4ee9b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480c0150 con 0x7fce48071e70 2024-01-27T14:32:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.725+0000 7fce4ee9b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4806e4b0 con 0x7fce480c8640 2024-01-27T14:32:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.726+0000 7fce4d438640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce480c8640 0x7fce480c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.726+0000 7fce47fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fce480c6310 0x7fce4815e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52160/0 (socket says 172.21.15.46:52160) 2024-01-27T14:32:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.726+0000 7fce47fff640 1 -- 172.21.15.46:0/2765700014 learned_addr learned my addr 172.21.15.46:0/2765700014 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:12.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.728+0000 7fce477fe640 1 -- 172.21.15.46:0/2765700014 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366116202 0 0) 0x7fce480bff20 con 0x7fce480c6310 2024-01-27T14:32:12.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.728+0000 7fce477fe640 1 -- 172.21.15.46:0/2765700014 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce38003520 con 0x7fce480c6310 2024-01-27T14:32:12.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.731+0000 7fce4d438640 1 -- 172.21.15.46:0/2765700014 >> v1:172.21.15.73:6789/0 conn(0x7fce48071e70 legacy=0x7fce48155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.731+0000 7fce4d438640 1 -- 172.21.15.46:0/2765700014 >> v1:172.21.15.46:6789/0 conn(0x7fce480c6310 legacy=0x7fce4815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.731+0000 7fce4d438640 1 -- 172.21.15.46:0/2765700014 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480c0410 con 0x7fce480c8640 2024-01-27T14:32:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.733+0000 7fce4d438640 1 --2- 172.21.15.46:0/2765700014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c8640 0x7fce480c1ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce4000aea0 tx=0x7fce4002d0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=291ca8190c4e0fb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce477fe640 1 -- 172.21.15.46:0/2765700014 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4002dc70 con 0x7fce480c8640 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce477fe640 1 -- 172.21.15.46:0/2765700014 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4002ddd0 con 0x7fce480c8640 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce477fe640 1 -- 172.21.15.46:0/2765700014 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40008660 con 0x7fce480c8640 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 -- 172.21.15.46:0/2765700014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c8640 msgr2=0x7fce480c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/2765700014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c8640 0x7fce480c1ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce4000aea0 tx=0x7fce4002d0d0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 -- 172.21.15.46:0/2765700014 shutdown_connections 2024-01-27T14:32:12.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/2765700014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c8640 0x7fce480c1ba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 -- 172.21.15.46:0/2765700014 >> 172.21.15.46:0/2765700014 conn(0x7fce480c7a00 msgr2=0x7fce480c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:12.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 -- 172.21.15.46:0/2765700014 shutdown_connections 2024-01-27T14:32:12.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.738+0000 7fce4ee9b640 1 -- 172.21.15.46:0/2765700014 wait complete. 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 Processor -- start 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 -- start start 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce48071e70 0x7fce48156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce480c8640 0x7fce48147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4814a290 con 0x7fce480c8640 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480c2430 con 0x7fce480c6310 2024-01-27T14:32:12.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.740+0000 7fce4ee9b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480c2710 con 0x7fce48071e70 2024-01-27T14:32:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.741+0000 7fce4d438640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce480c8640 0x7fce48147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.741+0000 7fce47fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.741+0000 7fce4cc37640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce48071e70 0x7fce48156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.741+0000 7fce47fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41248/0 (socket says 172.21.15.46:41248) 2024-01-27T14:32:12.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.741+0000 7fce47fff640 1 -- 172.21.15.46:0/1946612208 learned_addr learned my addr 172.21.15.46:0/1946612208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.745+0000 7fce47fff640 1 -- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce48071e70 msgr2=0x7fce48156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.745+0000 7fce47fff640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce48071e70 0x7fce48156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.745+0000 7fce47fff640 1 -- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce480c8640 msgr2=0x7fce48147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.745+0000 7fce47fff640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce480c8640 0x7fce48147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:12.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.745+0000 7fce47fff640 1 -- 172.21.15.46:0/1946612208 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4000ab80 con 0x7fce480c6310 2024-01-27T14:32:12.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.747+0000 7fce47fff640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c500 tx=0x7fce3400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.751+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34005ce0 con 0x7fce480c6310 2024-01-27T14:32:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.751+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34005e40 con 0x7fce480c6310 2024-01-27T14:32:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.751+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce480c29f0 con 0x7fce480c6310 2024-01-27T14:32:12.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.751+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34007330 con 0x7fce480c6310 2024-01-27T14:32:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.751+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce480c2fb0 con 0x7fce480c6310 2024-01-27T14:32:12.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.752+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce480742e0 con 0x7fce480c6310 2024-01-27T14:32:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.997+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fce34007550 con 0x7fce480c6310 2024-01-27T14:32:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.997+0000 7fce457fa640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 0x7fce2c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.997+0000 7fce4cc37640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 0x7fce2c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:12.998+0000 7fce4cc37640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 0x7fce2c06d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce3c001780 tx=0x7fce3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.001+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce34057e00 con 0x7fce480c6310 2024-01-27T14:32:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.010+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fce34054140 con 0x7fce480c6310 2024-01-27T14:32:13.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.201+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce480cace0 con 0x7fce480c6310 2024-01-27T14:32:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.206+0000 7fce457fa640 1 -- 172.21.15.46:0/1946612208 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce34057760 con 0x7fce480c6310 2024-01-27T14:32:13.202 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 msgr2=0x7fce2c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 0x7fce2c06d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce3c001780 tx=0x7fce3c009040 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 msgr2=0x7fce480c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c500 tx=0x7fce3400c9c0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 shutdown_connections 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fce2c06af20 0x7fce2c06d3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480c6310 0x7fce480c37b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce480c8640 0x7fce48147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 --2- 172.21.15.46:0/1946612208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce48071e70 0x7fce48156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 >> 172.21.15.46:0/1946612208 conn(0x7fce480c7a00 msgr2=0x7fce480ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 shutdown_connections 2024-01-27T14:32:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.208+0000 7fce4ee9b640 1 -- 172.21.15.46:0/1946612208 wait complete. 2024-01-27T14:32:13.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:32:13.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.323+0000 7f862895a640 1 Processor -- start 2024-01-27T14:32:13.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.323+0000 7f862895a640 1 -- start start 2024-01-27T14:32:13.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.324+0000 7f862895a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f862415b7c0 0x7f86240c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.324+0000 7f862895a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 0x7f8624070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.324+0000 7f862895a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862415ad20 con 0x7f8624151740 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.324+0000 7f862895a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240c73f0 con 0x7f862415b7c0 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.324+0000 7f862895a640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86240c86c0 con 0x7f8624157590 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.325+0000 7f8621d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f862415b7c0 0x7f86240c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.325+0000 7f8622d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 0x7f8624070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.325+0000 7f862259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8624151740 0x7f86240c7870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52168/0 (socket says 172.21.15.46:52168) 2024-01-27T14:32:13.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.325+0000 7f862259c640 1 -- 172.21.15.46:0/4115634754 learned_addr learned my addr 172.21.15.46:0/4115634754 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:13.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.327+0000 7f8622d9d640 1 -- 172.21.15.46:0/4115634754 >> v2:172.21.15.46:3300/0 conn(0x7f862415b7c0 msgr2=0x7f86240c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:13.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.327+0000 7f8622d9d640 1 --2- 172.21.15.46:0/4115634754 >> v2:172.21.15.46:3300/0 conn(0x7f862415b7c0 0x7f86240c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.328+0000 7f8622d9d640 1 -- 172.21.15.46:0/4115634754 >> v1:172.21.15.46:6789/0 conn(0x7f8624151740 legacy=0x7f86240c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.328+0000 7f8622d9d640 1 -- 172.21.15.46:0/4115634754 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240c8100 con 0x7f8624157590 2024-01-27T14:32:13.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.330+0000 7f8622d9d640 1 --2- 172.21.15.46:0/4115634754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 0x7f8624070e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e9c7172076a794 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:13.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.333+0000 7f862159a640 1 -- 172.21.15.46:0/4115634754 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861402cce0 con 0x7f8624157590 2024-01-27T14:32:13.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862159a640 1 -- 172.21.15.46:0/4115634754 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861402ce40 con 0x7f8624157590 2024-01-27T14:32:13.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862159a640 1 -- 172.21.15.46:0/4115634754 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614034660 con 0x7f8624157590 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 -- 172.21.15.46:0/4115634754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 msgr2=0x7f8624070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 --2- 172.21.15.46:0/4115634754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 0x7f8624070e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861402bf30 comp rx=0 tx=0).stop 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 -- 172.21.15.46:0/4115634754 shutdown_connections 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 --2- 172.21.15.46:0/4115634754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624157590 0x7f8624070e80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 --2- 172.21.15.46:0/4115634754 >> v2:172.21.15.46:3300/0 conn(0x7f862415b7c0 0x7f86240c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 -- 172.21.15.46:0/4115634754 >> 172.21.15.46:0/4115634754 conn(0x7f8624066ac0 msgr2=0x7f862406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 -- 172.21.15.46:0/4115634754 shutdown_connections 2024-01-27T14:32:13.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.334+0000 7f862895a640 1 -- 172.21.15.46:0/4115634754 wait complete. 2024-01-27T14:32:13.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 Processor -- start 2024-01-27T14:32:13.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 -- start start 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 0x7f862414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 0x7f86241edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 0x7f862414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86241573b0 con 0x7f8624157590 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86241ed4e0 con 0x7f862415b7c0 2024-01-27T14:32:13.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.336+0000 7f862895a640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8624156b30 con 0x7f8624151740 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f8621d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 0x7f86241edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f8622d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 0x7f862414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f862259c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 0x7f862414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f8621d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 0x7f86241edef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37350/0 (socket says 172.21.15.46:37350) 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f8622d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 0x7f862414c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:41252/0 (socket says 172.21.15.46:41252) 2024-01-27T14:32:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.337+0000 7f8621d9b640 1 -- 172.21.15.46:0/2241992396 learned_addr learned my addr 172.21.15.46:0/2241992396 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.340+0000 7f862259c640 1 -- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 msgr2=0x7f862414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.340+0000 7f862259c640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 0x7f862414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.340+0000 7f862259c640 1 -- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 msgr2=0x7f86241edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.340+0000 7f862259c640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 0x7f86241edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.340+0000 7f862259c640 1 -- 172.21.15.46:0/2241992396 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614009a70 con 0x7f8624151740 2024-01-27T14:32:13.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.343+0000 7f862259c640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 0x7f862414d500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c370 tx=0x7f861c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:13.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.346+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c005ce0 con 0x7f8624151740 2024-01-27T14:32:13.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.347+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c005e40 con 0x7f8624151740 2024-01-27T14:32:13.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.347+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c007310 con 0x7f8624151740 2024-01-27T14:32:13.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.347+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8624156860 con 0x7f8624151740 2024-01-27T14:32:13.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.347+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86241570d0 con 0x7f8624151740 2024-01-27T14:32:13.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.348+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86240742e0 con 0x7f8624151740 2024-01-27T14:32:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.589+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f861c007470 con 0x7f8624151740 2024-01-27T14:32:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.589+0000 7f861affd640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 0x7f860406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.589+0000 7f8621d9b640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 0x7f860406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.589+0000 7f8621d9b640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 0x7f860406d3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f862414d080 tx=0x7f860c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:13.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.591+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f861c007720 con 0x7f8624151740 2024-01-27T14:32:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.600+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f861c053f10 con 0x7f8624151740 2024-01-27T14:32:13.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.779+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86240b1fb0 con 0x7f8624151740 2024-01-27T14:32:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.784+0000 7f861affd640 1 -- 172.21.15.46:0/2241992396 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f861c017070 con 0x7f8624151740 2024-01-27T14:32:13.781 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 msgr2=0x7f860406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 0x7f860406d3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f862414d080 tx=0x7f860c008040 comp rx=0 tx=0).stop 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 msgr2=0x7f862414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 0x7f862414d500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c370 tx=0x7f861c00c830 comp rx=0 tx=0).stop 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 shutdown_connections 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f860406af20 0x7f860406d3e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f862415b7c0 0x7f862414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624157590 0x7f86241edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 --2- 172.21.15.46:0/2241992396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8624151740 0x7f862414d500 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 >> 172.21.15.46:0/2241992396 conn(0x7f8624066ac0 msgr2=0x7f86240cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 shutdown_connections 2024-01-27T14:32:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.786+0000 7f862895a640 1 -- 172.21.15.46:0/2241992396 wait complete. 2024-01-27T14:32:13.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:32:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.900+0000 7f345a333640 1 Processor -- start 2024-01-27T14:32:13.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.900+0000 7f345a333640 1 -- start start 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.901+0000 7f345a333640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 0x7f34540cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.901+0000 7f345a333640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34540cc750 con 0x7f34540cc2c0 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.901+0000 7f345a333640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345406bed0 con 0x7f3454153a20 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.901+0000 7f345a333640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345406cdc0 con 0x7f345415a3c0 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.902+0000 7f3453fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3454153a20 0x7f34540ca050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46852/0 (socket says 172.21.15.46:46852) 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.902+0000 7f3453fff640 1 -- 172.21.15.46:0/1825823945 learned_addr learned my addr 172.21.15.46:0/1825823945 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:13.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.902+0000 7f34537fe640 1 --2- 172.21.15.46:0/1825823945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 0x7f34540cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.904+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544001260 0 0) 0x7f345406bed0 con 0x7f3454153a20 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.904+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c003520 con 0x7f3454153a20 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.904+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484409122 0 0) 0x7f34540cc750 con 0x7f34540cc2c0 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.904+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345406bed0 con 0x7f34540cc2c0 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.905+0000 7f34537fe640 1 -- 172.21.15.46:0/1825823945 >> v1:172.21.15.73:6789/0 conn(0x7f3454153a20 legacy=0x7f34540ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.905+0000 7f34537fe640 1 -- 172.21.15.46:0/1825823945 >> v1:172.21.15.46:6789/0 conn(0x7f34540cc2c0 legacy=0x7f34540b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.905+0000 7f34537fe640 1 -- 172.21.15.46:0/1825823945 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345406c1b0 con 0x7f345415a3c0 2024-01-27T14:32:13.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.907+0000 7f34537fe640 1 --2- 172.21.15.46:0/1825823945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 0x7f34540cbd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34440097d0 tx=0x7f344402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a864b28b347b7719 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444030880 con 0x7f345415a3c0 2024-01-27T14:32:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34440309e0 con 0x7f345415a3c0 2024-01-27T14:32:13.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f3452ffd640 1 -- 172.21.15.46:0/1825823945 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444030d70 con 0x7f345415a3c0 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 -- 172.21.15.46:0/1825823945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 msgr2=0x7f34540cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 --2- 172.21.15.46:0/1825823945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 0x7f34540cbd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34440097d0 tx=0x7f344402b9c0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 -- 172.21.15.46:0/1825823945 shutdown_connections 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 --2- 172.21.15.46:0/1825823945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f345415a3c0 0x7f34540cbd80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 -- 172.21.15.46:0/1825823945 >> 172.21.15.46:0/1825823945 conn(0x7f3454071fd0 msgr2=0x7f34540723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 -- 172.21.15.46:0/1825823945 shutdown_connections 2024-01-27T14:32:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.911+0000 7f345a333640 1 -- 172.21.15.46:0/1825823945 wait complete. 2024-01-27T14:32:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.912+0000 7f345a333640 1 Processor -- start 2024-01-27T14:32:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.912+0000 7f345a333640 1 -- start start 2024-01-27T14:32:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34540cc2c0 0x7f34541e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3454153a20 0x7f34541e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541e5440 con 0x7f345415a3c0 2024-01-27T14:32:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541ef620 con 0x7f34540cc2c0 2024-01-27T14:32:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.913+0000 7f345a333640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345415aa80 con 0x7f3454153a20 2024-01-27T14:32:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.914+0000 7f34588d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.914+0000 7f34537fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3454153a20 0x7f34541e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.914+0000 7f3453fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34540cc2c0 0x7f34541e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.914+0000 7f34588d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37360/0 (socket says 172.21.15.46:37360) 2024-01-27T14:32:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.914+0000 7f34588d0640 1 -- 172.21.15.46:0/3697797152 learned_addr learned my addr 172.21.15.46:0/3697797152 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.917+0000 7f34588d0640 1 -- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3454153a20 msgr2=0x7f34541e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.917+0000 7f34588d0640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3454153a20 0x7f34541e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.917+0000 7f34588d0640 1 -- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34540cc2c0 msgr2=0x7f34541e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.917+0000 7f34588d0640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34540cc2c0 0x7f34541e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.917+0000 7f34588d0640 1 -- 172.21.15.46:0/3697797152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444009400 con 0x7f345415a3c0 2024-01-27T14:32:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.920+0000 7f34588d0640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c790 tx=0x7f344c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.923+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00cea0 con 0x7f345415a3c0 2024-01-27T14:32:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.923+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c003b70 con 0x7f345415a3c0 2024-01-27T14:32:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.923+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00a850 con 0x7f345415a3c0 2024-01-27T14:32:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.923+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345415ad60 con 0x7f345415a3c0 2024-01-27T14:32:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.923+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345415b320 con 0x7f345415a3c0 2024-01-27T14:32:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:13.924+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34541ef840 con 0x7f345415a3c0 2024-01-27T14:32:14.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.188+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f344c00a9b0 con 0x7f345415a3c0 2024-01-27T14:32:14.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.189+0000 7f3450ff9640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 0x7f344006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:14.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.189+0000 7f3453fff640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 0x7f344006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:14.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.189+0000 7f3453fff640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 0x7f344006d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3448000f60 tx=0x7f3448007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.204+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f344c0588e0 con 0x7f345415a3c0 2024-01-27T14:32:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.205+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f344c054c20 con 0x7f345415a3c0 2024-01-27T14:32:14.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.403+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34541ef840 con 0x7f345415a3c0 2024-01-27T14:32:14.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.408+0000 7f3450ff9640 1 -- 172.21.15.46:0/3697797152 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34541ef840 con 0x7f345415a3c0 2024-01-27T14:32:14.404 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 msgr2=0x7f344006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 0x7f344006d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3448000f60 tx=0x7f3448007d30 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 msgr2=0x7f345414ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c790 tx=0x7f344c00cc50 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 shutdown_connections 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f344006af50 0x7f344006d410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f345415a3c0 0x7f345414ea80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3454153a20 0x7f34541e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 --2- 172.21.15.46:0/3697797152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34540cc2c0 0x7f34541e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 >> 172.21.15.46:0/3697797152 conn(0x7f3454071fd0 msgr2=0x7f34540b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 shutdown_connections 2024-01-27T14:32:14.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:14.410+0000 7f345a333640 1 -- 172.21.15.46:0/3697797152 wait complete. 2024-01-27T14:32:14.417 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-27T14:32:14.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:14.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-27T14:32:14.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[43833]: fuse finished with error 0 and tester_r 0 2024-01-27T14:32:14.444 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:32:20.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:32:20.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:20.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-27T14:32:20.574 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:20.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.719+0000 7f8388353640 1 Processor -- start 2024-01-27T14:32:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.719+0000 7f8388353640 1 -- start start 2024-01-27T14:32:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f8388353640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 0x7f838015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f8388353640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838015ac90 con 0x7f83801519b0 2024-01-27T14:32:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f8388353640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838015bc20 con 0x7f83800c5da0 2024-01-27T14:32:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f8388353640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800b7150 con 0x7f83800715e0 2024-01-27T14:32:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f83860ef640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f83801519b0 0x7f83801576a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42252/0 (socket says 172.21.15.46:42252) 2024-01-27T14:32:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f83860ef640 1 -- 172.21.15.46:0/2335923743 learned_addr learned my addr 172.21.15.46:0/2335923743 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.720+0000 7f83868f0640 1 --2- 172.21.15.46:0/2335923743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 0x7f838015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710916441 0 0) 0x7f838015ac90 con 0x7f83801519b0 2024-01-27T14:32:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c003520 con 0x7f83801519b0 2024-01-27T14:32:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802052534 0 0) 0x7f838015bc20 con 0x7f83800c5da0 2024-01-27T14:32:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838015ac90 con 0x7f83800c5da0 2024-01-27T14:32:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83868f0640 1 -- 172.21.15.46:0/2335923743 >> v1:172.21.15.73:6789/0 conn(0x7f83800c5da0 legacy=0x7f83800c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83868f0640 1 -- 172.21.15.46:0/2335923743 >> v1:172.21.15.46:6789/0 conn(0x7f83801519b0 legacy=0x7f83801576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.723+0000 7f83868f0640 1 -- 172.21.15.46:0/2335923743 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380157f30 con 0x7f83800715e0 2024-01-27T14:32:20.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.725+0000 7f83868f0640 1 --2- 172.21.15.46:0/2335923743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 0x7f838015b6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8378009dc0 tx=0x7f837802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9460e0b376ff3221 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.729+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837802cd50 con 0x7f83800715e0 2024-01-27T14:32:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.729+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378034440 con 0x7f83800715e0 2024-01-27T14:32:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.729+0000 7f83850ed640 1 -- 172.21.15.46:0/2335923743 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780347d0 con 0x7f83800715e0 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 -- 172.21.15.46:0/2335923743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 msgr2=0x7f838015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 --2- 172.21.15.46:0/2335923743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 0x7f838015b6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8378009dc0 tx=0x7f837802bfa0 comp rx=0 tx=0).stop 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 -- 172.21.15.46:0/2335923743 shutdown_connections 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 --2- 172.21.15.46:0/2335923743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83800715e0 0x7f838015b6e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 -- 172.21.15.46:0/2335923743 >> 172.21.15.46:0/2335923743 conn(0x7f838006a6c0 msgr2=0x7f838006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 -- 172.21.15.46:0/2335923743 shutdown_connections 2024-01-27T14:32:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.730+0000 7f8388353640 1 -- 172.21.15.46:0/2335923743 wait complete. 2024-01-27T14:32:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.731+0000 7f8388353640 1 Processor -- start 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.731+0000 7f8388353640 1 -- start start 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 0x7f83801f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83801519b0 0x7f83801ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83801f3770 con 0x7f83800c5da0 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83801ef4e0 con 0x7f83800715e0 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f8388353640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800c3750 con 0x7f83801519b0 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f83858ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f83860ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 0x7f83801f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f83868f0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83801519b0 0x7f83801ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f83858ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57670/0 (socket says 172.21.15.46:57670) 2024-01-27T14:32:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.732+0000 7f83858ee640 1 -- 172.21.15.46:0/2498180056 learned_addr learned my addr 172.21.15.46:0/2498180056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83858ee640 1 -- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83801519b0 msgr2=0x7f83801ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83858ee640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83801519b0 0x7f83801ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83858ee640 1 -- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 msgr2=0x7f83801f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83858ee640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 0x7f83801f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83858ee640 1 -- 172.21.15.46:0/2498180056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009a70 con 0x7f83800c5da0 2024-01-27T14:32:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.736+0000 7f83860ef640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 0x7f83801f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.738+0000 7f83858ee640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f837000c420 tx=0x7f837000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.742+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83700052d0 con 0x7f83800c5da0 2024-01-27T14:32:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.742+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370005430 con 0x7f83800c5da0 2024-01-27T14:32:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.742+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370003810 con 0x7f83800c5da0 2024-01-27T14:32:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.742+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800c3a30 con 0x7f83800c5da0 2024-01-27T14:32:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.742+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83800c3ff0 con 0x7f83800c5da0 2024-01-27T14:32:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:20.743+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8380067c70 con 0x7f83800c5da0 2024-01-27T14:32:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.018+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8370003970 con 0x7f83800c5da0 2024-01-27T14:32:21.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.018+0000 7f8376ffd640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 0x7f836406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.018+0000 7f83860ef640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 0x7f836406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.019+0000 7f83860ef640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 0x7f836406d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f837c000f60 tx=0x7f837c007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.034+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8370057a00 con 0x7f83800c5da0 2024-01-27T14:32:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.034+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8370053d40 con 0x7f83800c5da0 2024-01-27T14:32:21.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.224+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83801ef2b0 con 0x7f83800c5da0 2024-01-27T14:32:21.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.342+0000 7f8376ffd640 1 -- 172.21.15.46:0/2498180056 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f83801ef2b0 con 0x7f83800c5da0 2024-01-27T14:32:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:21.339 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 msgr2=0x7f836406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 0x7f836406d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f837c000f60 tx=0x7f837c007d30 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 msgr2=0x7f8380156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f837000c420 tx=0x7f837000c8e0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 shutdown_connections 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f836406af00 0x7f836406d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83801519b0 0x7f83801ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83800c5da0 0x7f8380156670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 --2- 172.21.15.46:0/2498180056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83800715e0 0x7f83801f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 >> 172.21.15.46:0/2498180056 conn(0x7f838006a6c0 msgr2=0x7f838006fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:21.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 shutdown_connections 2024-01-27T14:32:21.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.344+0000 7f8388353640 1 -- 172.21.15.46:0/2498180056 wait complete. 2024-01-27T14:32:21.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.461+0000 7ff9e9d68640 1 Processor -- start 2024-01-27T14:32:21.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.461+0000 7ff9e9d68640 1 -- start start 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e9d68640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e9d68640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9e40c6980 0x7ff9e415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e9d68640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e415a140 con 0x7ff9e406e9e0 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e9d68640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40c2f70 con 0x7ff9e40c6980 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e9d68640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c80d0 con 0x7ff9e4150850 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e2ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff9e406e9e0 0x7ff9e40cc2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42262/0 (socket says 172.21.15.46:42262) 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e2ffd640 1 -- 172.21.15.46:0/2397526599 learned_addr learned my addr 172.21.15.46:0/2397526599 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e3fff640 1 --2- 172.21.15.46:0/2397526599 >> v2:172.21.15.73:3300/0 conn(0x7ff9e40c6980 0x7ff9e415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.462+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/2397526599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.465+0000 7ff9e37fe640 1 -- 172.21.15.46:0/2397526599 >> v2:172.21.15.73:3300/0 conn(0x7ff9e40c6980 msgr2=0x7ff9e415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:21.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.465+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/2397526599 >> v2:172.21.15.73:3300/0 conn(0x7ff9e40c6980 0x7ff9e415a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.465+0000 7ff9e37fe640 1 -- 172.21.15.46:0/2397526599 >> v1:172.21.15.46:6789/0 conn(0x7ff9e406e9e0 legacy=0x7ff9e40cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.465+0000 7ff9e37fe640 1 -- 172.21.15.46:0/2397526599 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40c83b0 con 0x7ff9e4150850 2024-01-27T14:32:21.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.467+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/2397526599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c7a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40097a0 tx=0x7ff9d402db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c239d4f9c00fdc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:21.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e27fc640 1 -- 172.21.15.46:0/2397526599 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d402e920 con 0x7ff9e4150850 2024-01-27T14:32:21.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e27fc640 1 -- 172.21.15.46:0/2397526599 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d402ea80 con 0x7ff9e4150850 2024-01-27T14:32:21.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e27fc640 1 -- 172.21.15.46:0/2397526599 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d402ee10 con 0x7ff9e4150850 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 -- 172.21.15.46:0/2397526599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 msgr2=0x7ff9e40c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/2397526599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c7a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40097a0 tx=0x7ff9d402db70 comp rx=0 tx=0).stop 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 -- 172.21.15.46:0/2397526599 shutdown_connections 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/2397526599 >> v2:172.21.15.73:3300/0 conn(0x7ff9e40c6980 0x7ff9e415a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/2397526599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c7a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 -- 172.21.15.46:0/2397526599 >> 172.21.15.46:0/2397526599 conn(0x7ff9e406b9b0 msgr2=0x7ff9e406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 -- 172.21.15.46:0/2397526599 shutdown_connections 2024-01-27T14:32:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.471+0000 7ff9e9d68640 1 -- 172.21.15.46:0/2397526599 wait complete. 2024-01-27T14:32:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 Processor -- start 2024-01-27T14:32:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 -- start start 2024-01-27T14:32:21.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e40c6980 0x7ff9e41eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41eb150 con 0x7ff9e40c6980 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e414d1c0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.473+0000 7ff9e9d68640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e414d710 con 0x7ff9e4150850 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.474+0000 7ff9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e40c6980 0x7ff9e41eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.474+0000 7ff9e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.474+0000 7ff9e37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:57544/0 (socket says 172.21.15.46:57544) 2024-01-27T14:32:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.474+0000 7ff9e37fe640 1 -- 172.21.15.46:0/1567840710 learned_addr learned my addr 172.21.15.46:0/1567840710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.478+0000 7ff9e37fe640 1 -- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 msgr2=0x7ff9e40c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.478+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.478+0000 7ff9e37fe640 1 -- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e40c6980 msgr2=0x7ff9e41eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.478+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e40c6980 0x7ff9e41eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.478+0000 7ff9e37fe640 1 -- 172.21.15.46:0/1567840710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4009400 con 0x7ff9e406e9e0 2024-01-27T14:32:21.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.480+0000 7ff9e37fe640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40098c0 tx=0x7ff9d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.484+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4041640 con 0x7ff9e406e9e0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.484+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40417c0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.484+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4041b70 con 0x7ff9e406e9e0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.484+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e41ee220 con 0x7ff9e406e9e0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.484+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e41ee7e0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.485+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e406daa0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.505+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff9d403d040 con 0x7ff9e406e9e0 2024-01-27T14:32:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.505+0000 7ff9cbfff640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 0x7ff9d006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.505+0000 7ff9e2ffd640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 0x7ff9d006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.506+0000 7ff9e2ffd640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 0x7ff9d006d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4148530 tx=0x7ff9d8007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:21.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.507+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff9d4054e40 con 0x7ff9e406e9e0 2024-01-27T14:32:21.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.744+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff9d4078eb0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.929+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9e40742e0 con 0x7ff9e406e9e0 2024-01-27T14:32:21.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.971+0000 7ff9cbfff640 1 -- 172.21.15.46:0/1567840710 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7ff9d4045090 con 0x7ff9e406e9e0 2024-01-27T14:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:21.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 msgr2=0x7ff9d006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 0x7ff9d006d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4148530 tx=0x7ff9d8007e80 comp rx=0 tx=0).stop 2024-01-27T14:32:21.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 msgr2=0x7ff9e41eed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:21.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40098c0 tx=0x7ff9d40046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 shutdown_connections 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff9d006af20 0x7ff9d006d3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9e4150850 0x7ff9e40c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e40c6980 0x7ff9e41eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 --2- 172.21.15.46:0/1567840710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e406e9e0 0x7ff9e41eed00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 >> 172.21.15.46:0/1567840710 conn(0x7ff9e406b9b0 msgr2=0x7ff9e406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 shutdown_connections 2024-01-27T14:32:21.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:21.973+0000 7ff9e9d68640 1 -- 172.21.15.46:0/1567840710 wait complete. 2024-01-27T14:32:21.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-27T14:32:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.091+0000 7fe700207640 1 Processor -- start 2024-01-27T14:32:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.091+0000 7fe700207640 1 -- start start 2024-01-27T14:32:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6f80ca3d0 0x7fe6f80c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6f815b520 0x7fe6f8157500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8158500 con 0x7fe6f815b520 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8157a40 con 0x7fe6f80ca3d0 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe700207640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f815b9b0 con 0x7fe6f8151810 2024-01-27T14:32:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe6fdfa3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.093+0000 7fe6fd7a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6f80ca3d0 0x7fe6f80c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.094+0000 7fe6fdfa3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:50874/0 (socket says 172.21.15.46:50874) 2024-01-27T14:32:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.094+0000 7fe6fdfa3640 1 -- 172.21.15.46:0/3595302910 learned_addr learned my addr 172.21.15.46:0/3595302910 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.096+0000 7fe6fdfa3640 1 -- 172.21.15.46:0/3595302910 >> v2:172.21.15.73:3300/0 conn(0x7fe6f80ca3d0 msgr2=0x7fe6f80c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:22.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.096+0000 7fe6fdfa3640 1 --2- 172.21.15.46:0/3595302910 >> v2:172.21.15.73:3300/0 conn(0x7fe6f80ca3d0 0x7fe6f80c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.096+0000 7fe6fdfa3640 1 -- 172.21.15.46:0/3595302910 >> v2:172.21.15.46:3300/0 conn(0x7fe6f815b520 msgr2=0x7fe6f8157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:22.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.096+0000 7fe6fdfa3640 1 --2- 172.21.15.46:0/3595302910 >> v2:172.21.15.46:3300/0 conn(0x7fe6f815b520 0x7fe6f8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.096+0000 7fe6fdfa3640 1 -- 172.21.15.46:0/3595302910 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f815aad0 con 0x7fe6f8151810 2024-01-27T14:32:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.098+0000 7fe6fdfa3640 1 --2- 172.21.15.46:0/3595302910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8071930 tx=0x7fe6f402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e0c4d643b50cbc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.101+0000 7fe6fcfa1640 1 -- 172.21.15.46:0/3595302910 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4030840 con 0x7fe6f8151810 2024-01-27T14:32:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.101+0000 7fe6fcfa1640 1 -- 172.21.15.46:0/3595302910 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40309a0 con 0x7fe6f8151810 2024-01-27T14:32:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.101+0000 7fe6fcfa1640 1 -- 172.21.15.46:0/3595302910 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4030d30 con 0x7fe6f8151810 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 -- 172.21.15.46:0/3595302910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 msgr2=0x7fe6f80ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 --2- 172.21.15.46:0/3595302910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8071930 tx=0x7fe6f402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 -- 172.21.15.46:0/3595302910 shutdown_connections 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 --2- 172.21.15.46:0/3595302910 >> v2:172.21.15.46:3300/0 conn(0x7fe6f815b520 0x7fe6f8157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 --2- 172.21.15.46:0/3595302910 >> v2:172.21.15.73:3300/0 conn(0x7fe6f80ca3d0 0x7fe6f80c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 --2- 172.21.15.46:0/3595302910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f80ccd10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 -- 172.21.15.46:0/3595302910 >> 172.21.15.46:0/3595302910 conn(0x7fe6f8066c80 msgr2=0x7fe6f806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 -- 172.21.15.46:0/3595302910 shutdown_connections 2024-01-27T14:32:22.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.102+0000 7fe700207640 1 -- 172.21.15.46:0/3595302910 wait complete. 2024-01-27T14:32:22.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.103+0000 7fe700207640 1 Processor -- start 2024-01-27T14:32:22.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.103+0000 7fe700207640 1 -- start start 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f80ca3d0 0x7fe6f81e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 0x7fe6f814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81e4430 con 0x7fe6f80ca3d0 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f806d2e0 con 0x7fe6f815b520 2024-01-27T14:32:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.104+0000 7fe700207640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81f24d0 con 0x7fe6f8151810 2024-01-27T14:32:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.105+0000 7fe6fd7a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.105+0000 7fe6fe7a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 0x7fe6f814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.105+0000 7fe6fd7a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:50878/0 (socket says 172.21.15.46:50878) 2024-01-27T14:32:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.105+0000 7fe6fd7a2640 1 -- 172.21.15.46:0/3028066394 learned_addr learned my addr 172.21.15.46:0/3028066394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fe7a4640 1 -- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 msgr2=0x7fe6f8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fe7a4640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fe7a4640 1 -- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f80ca3d0 msgr2=0x7fe6f81e0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fe7a4640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f80ca3d0 0x7fe6f81e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fe7a4640 1 -- 172.21.15.46:0/3028066394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40094d0 con 0x7fe6f815b520 2024-01-27T14:32:22.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.109+0000 7fe6fd7a2640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.111+0000 7fe6fe7a4640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 0x7fe6f814c200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000be20 tx=0x7fe6f000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.115+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000ce70 con 0x7fe6f815b520 2024-01-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.115+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f0014440 con 0x7fe6f815b520 2024-01-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.115+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0014810 con 0x7fe6f815b520 2024-01-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.115+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f806d510 con 0x7fe6f815b520 2024-01-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.115+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f81f2a30 con 0x7fe6f815b520 2024-01-27T14:32:22.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.116+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f80742e0 con 0x7fe6f815b520 2024-01-27T14:32:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.363+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe6f001d3b0 con 0x7fe6f815b520 2024-01-27T14:32:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.363+0000 7fe6ee7fc640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 0x7fe6dc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:22.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.364+0000 7fe6fdfa3640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 0x7fe6dc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:22.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.364+0000 7fe6fdfa3640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 0x7fe6dc06d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4036000 tx=0x7fe6f403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:22.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.368+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe6f0058830 con 0x7fe6f815b520 2024-01-27T14:32:22.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.381+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe6f0054b70 con 0x7fe6f815b520 2024-01-27T14:32:22.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:22.602+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe6f80c6f30 con 0x7fe6f815b520 2024-01-27T14:32:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.707+0000 7fe6ee7fc640 1 -- 172.21.15.46:0/3028066394 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe6f0019020 con 0x7fe6f815b520 2024-01-27T14:32:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 msgr2=0x7fe6dc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 0x7fe6dc06d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4036000 tx=0x7fe6f403b040 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 msgr2=0x7fe6f814c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 0x7fe6f814c200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000be20 tx=0x7fe6f000bf10 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 shutdown_connections 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe6dc06af20 0x7fe6dc06d3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f815b520 0x7fe6f814c200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6f8151810 0x7fe6f8070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 --2- 172.21.15.46:0/3028066394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f80ca3d0 0x7fe6f81e0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.709+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 >> 172.21.15.46:0/3028066394 conn(0x7fe6f8066c80 msgr2=0x7fe6f8158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.710+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 shutdown_connections 2024-01-27T14:32:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.710+0000 7fe700207640 1 -- 172.21.15.46:0/3028066394 wait complete. 2024-01-27T14:32:23.717 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-01-27T14:32:23.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-01-27T14:32:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.825+0000 7f5b608da640 1 Processor -- start 2024-01-27T14:32:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.825+0000 7f5b608da640 1 -- start start 2024-01-27T14:32:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b5c1507e0 0x7f5b5c157030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c072450 0x7f5b5c071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b5c1599f0 0x7f5b5c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0c19f0 con 0x7f5b5c1599f0 2024-01-27T14:32:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c156590 con 0x7f5b5c1507e0 2024-01-27T14:32:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b608da640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c150bc0 con 0x7f5b5c072450 2024-01-27T14:32:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.826+0000 7f5b5ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b5c1599f0 0x7f5b5c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.827+0000 7f5b53fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c072450 0x7f5b5c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.827+0000 7f5b5ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b5c1599f0 0x7f5b5c06da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57718/0 (socket says 172.21.15.46:57718) 2024-01-27T14:32:23.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.827+0000 7f5b5ad9d640 1 -- 172.21.15.46:0/4024176080 learned_addr learned my addr 172.21.15.46:0/4024176080 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:23.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.827+0000 7f5b5a59c640 1 --2- 172.21.15.46:0/4024176080 >> v2:172.21.15.73:3300/0 conn(0x7f5b5c1507e0 0x7f5b5c157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.829+0000 7f5b5ad9d640 1 -- 172.21.15.46:0/4024176080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c072450 msgr2=0x7f5b5c071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:23.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.829+0000 7f5b5ad9d640 1 --2- 172.21.15.46:0/4024176080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c072450 0x7f5b5c071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.829+0000 7f5b5ad9d640 1 -- 172.21.15.46:0/4024176080 >> v2:172.21.15.73:3300/0 conn(0x7f5b5c1507e0 msgr2=0x7f5b5c157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:23.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.829+0000 7f5b5ad9d640 1 --2- 172.21.15.46:0/4024176080 >> v2:172.21.15.73:3300/0 conn(0x7f5b5c1507e0 0x7f5b5c157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.829+0000 7f5b5ad9d640 1 -- 172.21.15.46:0/4024176080 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c15a2a0 con 0x7f5b5c1599f0 2024-01-27T14:32:23.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.831+0000 7f5b5ad9d640 1 --2- 172.21.15.46:0/4024176080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c06da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b1160 tx=0x7f5b5402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a940bee10e6ebc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b59d9b640 1 -- 172.21.15.46:0/4024176080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5402cb00 con 0x7f5b5c1599f0 2024-01-27T14:32:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b59d9b640 1 -- 172.21.15.46:0/4024176080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5402cc60 con 0x7f5b5c1599f0 2024-01-27T14:32:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b59d9b640 1 -- 172.21.15.46:0/4024176080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540343f0 con 0x7f5b5c1599f0 2024-01-27T14:32:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 -- 172.21.15.46:0/4024176080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 msgr2=0x7f5b5c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 --2- 172.21.15.46:0/4024176080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c06da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b1160 tx=0x7f5b5402bf60 comp rx=0 tx=0).stop 2024-01-27T14:32:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 -- 172.21.15.46:0/4024176080 shutdown_connections 2024-01-27T14:32:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 --2- 172.21.15.46:0/4024176080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c06da10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 --2- 172.21.15.46:0/4024176080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c072450 0x7f5b5c071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 --2- 172.21.15.46:0/4024176080 >> v2:172.21.15.73:3300/0 conn(0x7f5b5c1507e0 0x7f5b5c157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 -- 172.21.15.46:0/4024176080 >> 172.21.15.46:0/4024176080 conn(0x7f5b5c0c7a00 msgr2=0x7f5b5c0c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 -- 172.21.15.46:0/4024176080 shutdown_connections 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.835+0000 7f5b608da640 1 -- 172.21.15.46:0/4024176080 wait complete. 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.837+0000 7f5b608da640 1 Processor -- start 2024-01-27T14:32:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.837+0000 7f5b608da640 1 -- start start 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.837+0000 7f5b608da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 0x7f5b5c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b608da640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c1507e0 0x7f5b5c1f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b608da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b608da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1f1360 con 0x7f5b5c1599f0 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b608da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c14d6d0 con 0x7f5b5c072450 2024-01-27T14:32:23.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b608da640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1f1080 con 0x7f5b5c1507e0 2024-01-27T14:32:23.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b53fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c1507e0 0x7f5b5c1f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b5a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 0x7f5b5c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c14db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57730/0 (socket says 172.21.15.46:57730) 2024-01-27T14:32:23.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.838+0000 7f5b5ad9d640 1 -- 172.21.15.46:0/3024216733 learned_addr learned my addr 172.21.15.46:0/3024216733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:23.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.842+0000 7f5b5a59c640 1 -- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c1507e0 msgr2=0x7f5b5c1f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:23.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.842+0000 7f5b5a59c640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c1507e0 0x7f5b5c1f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.842+0000 7f5b5a59c640 1 -- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 msgr2=0x7f5b5c14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:23.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.842+0000 7f5b5a59c640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:23.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.842+0000 7f5b5a59c640 1 -- 172.21.15.46:0/3024216733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009b30 con 0x7f5b5c072450 2024-01-27T14:32:23.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.844+0000 7f5b5a59c640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 0x7f5b5c1539f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e870 tx=0x7f5b4c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.848+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00ee60 con 0x7f5b5c072450 2024-01-27T14:32:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.848+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c00c940 con 0x7f5b5c072450 2024-01-27T14:32:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.848+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00ccd0 con 0x7f5b5c072450 2024-01-27T14:32:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.848+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c151c60 con 0x7f5b5c072450 2024-01-27T14:32:23.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.848+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c152220 con 0x7f5b5c072450 2024-01-27T14:32:23.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.849+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c067c70 con 0x7f5b5c072450 2024-01-27T14:32:23.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.868+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5b4c013470 con 0x7f5b5c072450 2024-01-27T14:32:23.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.868+0000 7f5b52ffd640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 0x7f5b3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:23.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.869+0000 7f5b53fff640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 0x7f5b3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:23.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:23.869+0000 7f5b53fff640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 0x7f5b3c06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b0940 tx=0x7f5b44009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.095+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5b4c00ce30 con 0x7f5b5c072450 2024-01-27T14:32:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.104+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5b4c054cd0 con 0x7f5b5c072450 2024-01-27T14:32:24.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.328+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f5b5c0742e0 con 0x7f5b5c072450 2024-01-27T14:32:24.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.824+0000 7f5b52ffd640 1 -- 172.21.15.46:0/3024216733 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5b4c0210b0 con 0x7f5b5c072450 2024-01-27T14:32:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 msgr2=0x7f5b3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 0x7f5b3c06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b0940 tx=0x7f5b44009190 comp rx=0 tx=0).stop 2024-01-27T14:32:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 msgr2=0x7f5b5c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 0x7f5b5c1539f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e870 tx=0x7f5b4c00ed30 comp rx=0 tx=0).stop 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 shutdown_connections 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5b3c06af00 0x7f5b3c06d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b5c1599f0 0x7f5b5c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b5c1507e0 0x7f5b5c1f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 --2- 172.21.15.46:0/3024216733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b5c072450 0x7f5b5c1539f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 >> 172.21.15.46:0/3024216733 conn(0x7f5b5c0c7a00 msgr2=0x7f5b5c06d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 shutdown_connections 2024-01-27T14:32:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.826+0000 7f5b608da640 1 -- 172.21.15.46:0/3024216733 wait complete. 2024-01-27T14:32:24.834 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-27T14:32:24.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.944+0000 7f126ea97640 1 Processor -- start 2024-01-27T14:32:24.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.944+0000 7f126ea97640 1 -- start start 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.945+0000 7f126ea97640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 0x7f12680ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.945+0000 7f126ea97640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f12680cc490 0x7f12680ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.945+0000 7f126ea97640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126806bed0 con 0x7f126815a3c0 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.945+0000 7f126ea97640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126806cdc0 con 0x7f12680cc490 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.945+0000 7f126ea97640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126806c1b0 con 0x7f1268153a20 2024-01-27T14:32:24.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.946+0000 7f126c833640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 0x7f12680ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:24.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.946+0000 7f126c833640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 0x7f12680ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56374/0 (socket says 172.21.15.46:56374) 2024-01-27T14:32:24.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.946+0000 7f126c833640 1 -- 172.21.15.46:0/1973917714 learned_addr learned my addr 172.21.15.46:0/1973917714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:24.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.946+0000 7f126d034640 1 --2- 172.21.15.46:0/1973917714 >> v2:172.21.15.46:3300/0 conn(0x7f12680cc490 0x7f12680ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:24.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.949+0000 7f126d034640 1 -- 172.21.15.46:0/1973917714 >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 msgr2=0x7f12680ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:24.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.949+0000 7f126d034640 1 --2- 172.21.15.46:0/1973917714 >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 0x7f12680ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.949+0000 7f126d034640 1 -- 172.21.15.46:0/1973917714 >> v1:172.21.15.73:6789/0 conn(0x7f126815a3c0 legacy=0x7f12680cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.949+0000 7f126d034640 1 -- 172.21.15.46:0/1973917714 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126806c490 con 0x7f12680cc490 2024-01-27T14:32:24.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.951+0000 7f126d034640 1 --2- 172.21.15.46:0/1973917714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12680cc490 0x7f12680ca590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f126808cb60 tx=0x7f126002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462e9bd7a339a161 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:24.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.955+0000 7f12677fe640 1 -- 172.21.15.46:0/1973917714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126002cd00 con 0x7f12680cc490 2024-01-27T14:32:24.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.955+0000 7f12677fe640 1 -- 172.21.15.46:0/1973917714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126002ce60 con 0x7f12680cc490 2024-01-27T14:32:24.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.955+0000 7f12677fe640 1 -- 172.21.15.46:0/1973917714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260034660 con 0x7f12680cc490 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 -- 172.21.15.46:0/1973917714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12680cc490 msgr2=0x7f12680ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 --2- 172.21.15.46:0/1973917714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12680cc490 0x7f12680ca590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f126808cb60 tx=0x7f126002bf50 comp rx=0 tx=0).stop 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 -- 172.21.15.46:0/1973917714 shutdown_connections 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 --2- 172.21.15.46:0/1973917714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12680cc490 0x7f12680ca590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 --2- 172.21.15.46:0/1973917714 >> v2:172.21.15.73:3300/0 conn(0x7f1268153a20 0x7f12680ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 -- 172.21.15.46:0/1973917714 >> 172.21.15.46:0/1973917714 conn(0x7f1268071fd0 msgr2=0x7f12680723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 -- 172.21.15.46:0/1973917714 shutdown_connections 2024-01-27T14:32:24.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.956+0000 7f126ea97640 1 -- 172.21.15.46:0/1973917714 wait complete. 2024-01-27T14:32:24.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.957+0000 7f126ea97640 1 Processor -- start 2024-01-27T14:32:24.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.957+0000 7f126ea97640 1 -- start start 2024-01-27T14:32:24.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12680cc490 0x7f126814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f126815a3c0 0x7f126814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126814b9e0 con 0x7f1268153a20 2024-01-27T14:32:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12681f3c40 con 0x7f12680cc490 2024-01-27T14:32:24.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f126ea97640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c6e10 con 0x7f126815a3c0 2024-01-27T14:32:24.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.958+0000 7f1267fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:24.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.959+0000 7f126d034640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f126815a3c0 0x7f126814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:24.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.959+0000 7f126c833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12680cc490 0x7f126814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:24.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.959+0000 7f1267fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52850/0 (socket says 172.21.15.46:52850) 2024-01-27T14:32:24.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.959+0000 7f1267fff640 1 -- 172.21.15.46:0/2065438842 learned_addr learned my addr 172.21.15.46:0/2065438842 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.962+0000 7f1267fff640 1 -- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f126815a3c0 msgr2=0x7f126814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.962+0000 7f1267fff640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f126815a3c0 0x7f126814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.962+0000 7f1267fff640 1 -- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12680cc490 msgr2=0x7f126814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.962+0000 7f1267fff640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12680cc490 0x7f126814b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:24.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.962+0000 7f1267fff640 1 -- 172.21.15.46:0/2065438842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009a70 con 0x7f1268153a20 2024-01-27T14:32:24.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.965+0000 7f1267fff640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c3c0 tx=0x7f125c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:24.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.968+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0052d0 con 0x7f1268153a20 2024-01-27T14:32:24.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.968+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c005450 con 0x7f1268153a20 2024-01-27T14:32:24.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.968+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1268153f80 con 0x7f1268153a20 2024-01-27T14:32:24.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.968+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c007260 con 0x7f1268153a20 2024-01-27T14:32:24.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.968+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12680c73d0 con 0x7f1268153a20 2024-01-27T14:32:24.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:24.970+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12680c9640 con 0x7f1268153a20 2024-01-27T14:32:25.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.232+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f125c0073c0 con 0x7f1268153a20 2024-01-27T14:32:25.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.233+0000 7f12657fa640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 0x7f125406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:25.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.233+0000 7f126c833640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 0x7f125406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:25.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.233+0000 7f126c833640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 0x7f125406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1258009bd0 tx=0x7f1258009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.247+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f125c057ab0 con 0x7f1268153a20 2024-01-27T14:32:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.247+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f125c053df0 con 0x7f1268153a20 2024-01-27T14:32:25.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.482+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f12680742e0 con 0x7f1268153a20 2024-01-27T14:32:25.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.900+0000 7f12657fa640 1 -- 172.21.15.46:0/2065438842 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f125c020020 con 0x7f1268153a20 2024-01-27T14:32:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 msgr2=0x7f125406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 0x7f125406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1258009bd0 tx=0x7f1258009240 comp rx=0 tx=0).stop 2024-01-27T14:32:25.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 msgr2=0x7f126814bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c3c0 tx=0x7f125c00c880 comp rx=0 tx=0).stop 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 shutdown_connections 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f125406af50 0x7f125406d410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f126815a3c0 0x7f126814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1268153a20 0x7f126814bec0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 --2- 172.21.15.46:0/2065438842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12680cc490 0x7f126814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.902+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 >> 172.21.15.46:0/2065438842 conn(0x7f1268071fd0 msgr2=0x7f12680b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.903+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 shutdown_connections 2024-01-27T14:32:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:25.903+0000 7f126ea97640 1 -- 172.21.15.46:0/2065438842 wait complete. 2024-01-27T14:32:25.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-27T14:32:26.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.023+0000 7f9fe45de640 1 Processor -- start 2024-01-27T14:32:26.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.023+0000 7f9fe45de640 1 -- start start 2024-01-27T14:32:26.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe45de640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9fdc15a3c0 0x7f9fdc0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe45de640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 0x7f9fdc0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe45de640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fdc0cc750 con 0x7f9fdc153a20 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe45de640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc06cdc0 con 0x7f9fdc15a3c0 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe45de640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc06bed0 con 0x7f9fdc0cc2c0 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe237a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9fdc153a20 0x7f9fdc0ca050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:37070/0 (socket says 172.21.15.46:37070) 2024-01-27T14:32:26.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.024+0000 7f9fe237a640 1 -- 172.21.15.46:0/1564735269 learned_addr learned my addr 172.21.15.46:0/1564735269 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.036+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933206625 0 0) 0x7f9fdc0cc750 con 0x7f9fdc153a20 2024-01-27T14:32:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.036+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc4003520 con 0x7f9fdc153a20 2024-01-27T14:32:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.037+0000 7f9fe1b79640 1 --2- 172.21.15.46:0/1564735269 >> v2:172.21.15.46:3300/0 conn(0x7f9fdc15a3c0 0x7f9fdc0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.042+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657102303 0 0) 0x7f9fc4003520 con 0x7f9fdc153a20 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.042+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 msgr2=0x7f9fdc0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.042+0000 7f9fe1378640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 0x7f9fdc0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 >> v2:172.21.15.46:3300/0 conn(0x7f9fdc15a3c0 msgr2=0x7f9fdc0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 --2- 172.21.15.46:0/1564735269 >> v2:172.21.15.46:3300/0 conn(0x7f9fdc15a3c0 0x7f9fdc0cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc06c1b0 con 0x7f9fdc153a20 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f9fd4001670 con 0x7f9fdc153a20 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 >> v1:172.21.15.73:6789/0 conn(0x7f9fdc153a20 legacy=0x7f9fdc0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4003970 0x7f9fc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 0x7f9fc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc06cdc0 con 0x7f9fc4003970 2024-01-27T14:32:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc06bed0 con 0x7f9fc4004d00 2024-01-27T14:32:26.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.043+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc400bb40 con 0x7f9fdc0cc2c0 2024-01-27T14:32:26.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.047+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe237a640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4003970 0x7f9fc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 msgr2=0x7f9fc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc0cc2c0 0x7f9fc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1564735269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4003970 msgr2=0x7f9fc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4003970 0x7f9fc4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.051+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1564735269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4003520 con 0x7f9fc4004d00 2024-01-27T14:32:26.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.053+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009e10 tx=0x7f9fc40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60494b2556a552b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:26.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.057+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc02cd50 con 0x7f9fc4004d00 2024-01-27T14:32:26.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.057+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc034440 con 0x7f9fc4004d00 2024-01-27T14:32:26.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.057+0000 7f9fe1378640 1 -- 172.21.15.46:0/1564735269 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc034830 con 0x7f9fc4004d00 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 -- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc4004d00 msgr2=0x7f9fc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1564735269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009e10 tx=0x7f9fc40057f0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1564735269 reap_dead start 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 -- 172.21.15.46:0/1564735269 shutdown_connections 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 -- 172.21.15.46:0/1564735269 >> 172.21.15.46:0/1564735269 conn(0x7f9fdc071fd0 msgr2=0x7f9fdc0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 -- 172.21.15.46:0/1564735269 shutdown_connections 2024-01-27T14:32:26.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.058+0000 7f9fe45de640 1 -- 172.21.15.46:0/1564735269 wait complete. 2024-01-27T14:32:26.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.059+0000 7f9fe45de640 1 Processor -- start 2024-01-27T14:32:26.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.059+0000 7f9fe45de640 1 -- start start 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 0x7f9fdc1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc158c30 0x7f9fdc0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 0x7f9fdc1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc15ab80 con 0x7f9fc4004d00 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc15ae60 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.060+0000 7f9fe45de640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc15b140 con 0x7f9fdc158c30 2024-01-27T14:32:26.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.061+0000 7f9fe237a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 0x7f9fdc1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.061+0000 7f9fe2b7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 0x7f9fdc1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.061+0000 7f9fe237a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 0x7f9fdc1593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52880/0 (socket says 172.21.15.46:52880) 2024-01-27T14:32:26.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.061+0000 7f9fe237a640 1 -- 172.21.15.46:0/1703898856 learned_addr learned my addr 172.21.15.46:0/1703898856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:26.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.064+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc158c30 msgr2=0x7f9fdc0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:26.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.064+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc158c30 0x7f9fdc0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.064+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 msgr2=0x7f9fdc1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:26.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.064+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 0x7f9fdc1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:26.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.064+0000 7f9fe2b7b640 1 -- 172.21.15.46:0/1703898856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc15b420 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.068+0000 7f9fe2b7b640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 0x7f9fdc1f3070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc033000 tx=0x7f9fcc004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:26.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.072+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc034d80 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.072+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc03f420 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.072+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc03f7d0 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.072+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc0b3ba0 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.072+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc1f3790 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.073+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc15b5b0 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.092+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9fcc03f930 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.092+0000 7f9fdaffd640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 0x7f9fc806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.092+0000 7f9fe237a640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 0x7f9fc806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.093+0000 7f9fe237a640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 0x7f9fc806d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4004be0 tx=0x7f9fd4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:26.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.094+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9fcc052e30 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.374+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9fcc076d60 con 0x7f9fdc0b1ba0 2024-01-27T14:32:26.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:26.592+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f9fdc15afa0 con 0x7f9fdc0b1ba0 2024-01-27T14:32:27.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.111+0000 7f9fdaffd640 1 -- 172.21.15.46:0/1703898856 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9fcc0390b0 con 0x7f9fdc0b1ba0 2024-01-27T14:32:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 msgr2=0x7f9fc806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 0x7f9fc806d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4004be0 tx=0x7f9fd4009040 comp rx=0 tx=0).stop 2024-01-27T14:32:27.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 msgr2=0x7f9fdc1f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 0x7f9fdc1f3070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc033000 tx=0x7f9fcc004b50 comp rx=0 tx=0).stop 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 shutdown_connections 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9fc806af50 0x7f9fc806d410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fdc0b1ba0 0x7f9fdc1f3070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9fdc158c30 0x7f9fdc0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 --2- 172.21.15.46:0/1703898856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fc4004d00 0x7f9fdc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 >> 172.21.15.46:0/1703898856 conn(0x7f9fdc071fd0 msgr2=0x7f9fdc151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.113+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 shutdown_connections 2024-01-27T14:32:27.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.114+0000 7f9fe45de640 1 -- 172.21.15.46:0/1703898856 wait complete. 2024-01-27T14:32:27.121 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-27T14:32:27.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:32:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.229+0000 7f6bf007c640 1 Processor -- start 2024-01-27T14:32:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.229+0000 7f6bf007c640 1 -- start start 2024-01-27T14:32:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bf007c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 0x7f6be815a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bf007c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6be80cb3e0 0x7f6be80c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bf007c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be815a750 con 0x7f6be806c0f0 2024-01-27T14:32:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bf007c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be815d910 con 0x7f6be80cb3e0 2024-01-27T14:32:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bf007c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815cd20 con 0x7f6be8153a10 2024-01-27T14:32:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.230+0000 7f6bede18640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 0x7f6be815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.231+0000 7f6bee619640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6be80cb3e0 0x7f6be80c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.231+0000 7f6bed617640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6be806c0f0 0x7f6be806b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57270/0 (socket says 172.21.15.46:57270) 2024-01-27T14:32:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.231+0000 7f6bed617640 1 -- 172.21.15.46:0/1356241647 learned_addr learned my addr 172.21.15.46:0/1356241647 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:27.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.233+0000 7f6bede18640 1 -- 172.21.15.46:0/1356241647 >> v2:172.21.15.73:3300/0 conn(0x7f6be80cb3e0 msgr2=0x7f6be80c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.233+0000 7f6bede18640 1 --2- 172.21.15.46:0/1356241647 >> v2:172.21.15.73:3300/0 conn(0x7f6be80cb3e0 0x7f6be80c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.233+0000 7f6bede18640 1 -- 172.21.15.46:0/1356241647 >> v1:172.21.15.46:6789/0 conn(0x7f6be806c0f0 legacy=0x7f6be806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.233+0000 7f6bede18640 1 -- 172.21.15.46:0/1356241647 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be806c5a0 con 0x7f6be8153a10 2024-01-27T14:32:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.235+0000 7f6bede18640 1 --2- 172.21.15.46:0/1356241647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 0x7f6be815a210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ea68d97769fec9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:27.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bece16640 1 -- 172.21.15.46:0/1356241647 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0030610 con 0x7f6be8153a10 2024-01-27T14:32:27.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bece16640 1 -- 172.21.15.46:0/1356241647 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0030770 con 0x7f6be8153a10 2024-01-27T14:32:27.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bece16640 1 -- 172.21.15.46:0/1356241647 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0030b00 con 0x7f6be8153a10 2024-01-27T14:32:27.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 -- 172.21.15.46:0/1356241647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 msgr2=0x7f6be815a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 --2- 172.21.15.46:0/1356241647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 0x7f6be815a210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002b960 comp rx=0 tx=0).stop 2024-01-27T14:32:27.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 -- 172.21.15.46:0/1356241647 shutdown_connections 2024-01-27T14:32:27.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 --2- 172.21.15.46:0/1356241647 >> v2:172.21.15.73:3300/0 conn(0x7f6be80cb3e0 0x7f6be80c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 --2- 172.21.15.46:0/1356241647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be8153a10 0x7f6be815a210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 -- 172.21.15.46:0/1356241647 >> 172.21.15.46:0/1356241647 conn(0x7f6be80cf050 msgr2=0x7f6be80cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 -- 172.21.15.46:0/1356241647 shutdown_connections 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.240+0000 7f6bf007c640 1 -- 172.21.15.46:0/1356241647 wait complete. 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.241+0000 7f6bf007c640 1 Processor -- start 2024-01-27T14:32:27.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 -- start start 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be80cb3e0 0x7f6be81ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8153a10 0x7f6be81efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c6b40 con 0x7f6be8153a10 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c90f0 con 0x7f6be806c0f0 2024-01-27T14:32:27.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.242+0000 7f6bf007c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c6d90 con 0x7f6be80cb3e0 2024-01-27T14:32:27.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.243+0000 7f6bede18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.244+0000 7f6bede18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56410/0 (socket says 172.21.15.46:56410) 2024-01-27T14:32:27.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.244+0000 7f6bede18640 1 -- 172.21.15.46:0/835245633 learned_addr learned my addr 172.21.15.46:0/835245633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:27.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.245+0000 7f6bed617640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be80cb3e0 0x7f6be81ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.246+0000 7f6bee619640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8153a10 0x7f6be81efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.247+0000 7f6bede18640 1 -- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be80cb3e0 msgr2=0x7f6be81ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.247+0000 7f6bede18640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be80cb3e0 0x7f6be81ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.247+0000 7f6bede18640 1 -- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8153a10 msgr2=0x7f6be81efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.247+0000 7f6bede18640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8153a10 0x7f6be81efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.247+0000 7f6bede18640 1 -- 172.21.15.46:0/835245633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009400 con 0x7f6be806c0f0 2024-01-27T14:32:27.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.250+0000 7f6bede18640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6be002bf70 tx=0x7f6be00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:27.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.254+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be003e070 con 0x7f6be806c0f0 2024-01-27T14:32:27.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.254+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0030e10 con 0x7f6be806c0f0 2024-01-27T14:32:27.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.254+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0039c30 con 0x7f6be806c0f0 2024-01-27T14:32:27.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.254+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80c7070 con 0x7f6be806c0f0 2024-01-27T14:32:27.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.254+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80b1ea0 con 0x7f6be806c0f0 2024-01-27T14:32:27.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.255+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be80742e0 con 0x7f6be806c0f0 2024-01-27T14:32:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.518+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6be00423f0 con 0x7f6be806c0f0 2024-01-27T14:32:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.518+0000 7f6bde7fc640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 0x7f6bcc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.518+0000 7f6bed617640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 0x7f6bcc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.519+0000 7f6bed617640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 0x7f6bcc06d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6be80ce530 tx=0x7f6bd8007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.521+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6be007a290 con 0x7f6be806c0f0 2024-01-27T14:32:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.533+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6be00765d0 con 0x7f6be806c0f0 2024-01-27T14:32:27.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:32:27.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:32:27.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.772+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be80b4170 con 0x7f6be806c0f0 2024-01-27T14:32:27.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.785+0000 7f6bde7fc640 1 -- 172.21.15.46:0/835245633 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6547 (secure 0 0 0) 0x7f6be0048090 con 0x7f6be806c0f0 2024-01-27T14:32:27.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:27.782 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:27.039929+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:32:27.782 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-01-27T14:32:27.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 msgr2=0x7f6bcc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 0x7f6bcc06d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6be80ce530 tx=0x7f6bd8007e80 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 msgr2=0x7f6be8151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6be002bf70 tx=0x7f6be00046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 shutdown_connections 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6bcc06af20 0x7f6bcc06d3e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be8153a10 0x7f6be81efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6be80cb3e0 0x7f6be81ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 --2- 172.21.15.46:0/835245633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be806c0f0 0x7f6be8151bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 >> 172.21.15.46:0/835245633 conn(0x7f6be80cf050 msgr2=0x7f6be80cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 shutdown_connections 2024-01-27T14:32:27.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.787+0000 7f6bf007c640 1 -- 172.21.15.46:0/835245633 wait complete. 2024-01-27T14:32:27.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.900+0000 7f9529f68640 1 Processor -- start 2024-01-27T14:32:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.900+0000 7f9529f68640 1 -- start start 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.901+0000 7f9529f68640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9524153a90 0x7f952406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.901+0000 7f9529f68640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f952406baf0 0x7f95240c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.901+0000 7f9529f68640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952415da30 con 0x7f95240c8350 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.901+0000 7f9529f68640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952415dcf0 con 0x7f952406baf0 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.901+0000 7f9529f68640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9524159930 con 0x7f9524153a90 2024-01-27T14:32:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.902+0000 7f9522ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f952406baf0 0x7f95240c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.902+0000 7f95237fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9524153a90 0x7f952406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.902+0000 7f95237fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9524153a90 0x7f952406bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56420/0 (socket says 172.21.15.46:56420) 2024-01-27T14:32:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.902+0000 7f95237fe640 1 -- 172.21.15.46:0/101797962 learned_addr learned my addr 172.21.15.46:0/101797962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.904+0000 7f95237fe640 1 -- 172.21.15.46:0/101797962 >> v2:172.21.15.46:3300/0 conn(0x7f952406baf0 msgr2=0x7f95240c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.904+0000 7f95237fe640 1 --2- 172.21.15.46:0/101797962 >> v2:172.21.15.46:3300/0 conn(0x7f952406baf0 0x7f95240c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.904+0000 7f95237fe640 1 -- 172.21.15.46:0/101797962 >> v1:172.21.15.46:6789/0 conn(0x7f95240c8350 legacy=0x7f952415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.904+0000 7f95237fe640 1 -- 172.21.15.46:0/101797962 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524159c10 con 0x7f9524153a90 2024-01-27T14:32:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.906+0000 7f95237fe640 1 --2- 172.21.15.46:0/101797962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524153a90 0x7f952406bfd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9524071b60 tx=0x7f951402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f1f1cf1aacffe98 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:27.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.910+0000 7f95227fc640 1 -- 172.21.15.46:0/101797962 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951402f850 con 0x7f9524153a90 2024-01-27T14:32:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.910+0000 7f95227fc640 1 -- 172.21.15.46:0/101797962 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951402f9b0 con 0x7f9524153a90 2024-01-27T14:32:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.910+0000 7f95227fc640 1 -- 172.21.15.46:0/101797962 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951402fd40 con 0x7f9524153a90 2024-01-27T14:32:27.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 -- 172.21.15.46:0/101797962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524153a90 msgr2=0x7f952406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 --2- 172.21.15.46:0/101797962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524153a90 0x7f952406bfd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9524071b60 tx=0x7f951402ba30 comp rx=0 tx=0).stop 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 -- 172.21.15.46:0/101797962 shutdown_connections 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 --2- 172.21.15.46:0/101797962 >> v2:172.21.15.46:3300/0 conn(0x7f952406baf0 0x7f95240c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 --2- 172.21.15.46:0/101797962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524153a90 0x7f952406bfd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 -- 172.21.15.46:0/101797962 >> 172.21.15.46:0/101797962 conn(0x7f9524070e40 msgr2=0x7f9524071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 -- 172.21.15.46:0/101797962 shutdown_connections 2024-01-27T14:32:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.911+0000 7f9529f68640 1 -- 172.21.15.46:0/101797962 wait complete. 2024-01-27T14:32:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.912+0000 7f9529f68640 1 Processor -- start 2024-01-27T14:32:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.912+0000 7f9529f68640 1 -- start start 2024-01-27T14:32:27.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952406baf0 0x7f95241f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9524153a90 0x7f95240c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240c61e0 con 0x7f952406baf0 2024-01-27T14:32:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95241f0850 con 0x7f95240c8350 2024-01-27T14:32:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.913+0000 7f9529f68640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952414a050 con 0x7f9524153a90 2024-01-27T14:32:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.914+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.914+0000 7f95237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952406baf0 0x7f95241f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.914+0000 7f9523fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9524153a90 0x7f95240c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.914+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56434/0 (socket says 172.21.15.46:56434) 2024-01-27T14:32:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.914+0000 7f9522ffd640 1 -- 172.21.15.46:0/2930449982 learned_addr learned my addr 172.21.15.46:0/2930449982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.917+0000 7f9522ffd640 1 -- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9524153a90 msgr2=0x7f95240c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.917+0000 7f9522ffd640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9524153a90 0x7f95240c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.917+0000 7f9522ffd640 1 -- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952406baf0 msgr2=0x7f95241f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.917+0000 7f9522ffd640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952406baf0 0x7f95241f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.917+0000 7f9522ffd640 1 -- 172.21.15.46:0/2930449982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140094d0 con 0x7f95240c8350 2024-01-27T14:32:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.919+0000 7f9522ffd640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e9b0 tx=0x7f950c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.923+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c009670 con 0x7f95240c8350 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.923+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c00c9a0 con 0x7f95240c8350 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.923+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95241544c0 con 0x7f95240c8350 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.923+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00cd50 con 0x7f95240c8350 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.923+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9524154a80 con 0x7f95240c8350 2024-01-27T14:32:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:27.924+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95240c6030 con 0x7f95240c8350 2024-01-27T14:32:28.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.177+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f950c013470 con 0x7f95240c8350 2024-01-27T14:32:28.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.177+0000 7f951bfff640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 0x7f950406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.178+0000 7f95237fe640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 0x7f950406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.178+0000 7f95237fe640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 0x7f950406d3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9514036000 tx=0x7f9514008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:28.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.181+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f950c058be0 con 0x7f95240c8350 2024-01-27T14:32:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.191+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f950c054f20 con 0x7f95240c8350 2024-01-27T14:32:28.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.390+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95240c2750 con 0x7f95240c8350 2024-01-27T14:32:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.428+0000 7f951bfff640 1 -- 172.21.15.46:0/2930449982 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f950c021090 con 0x7f95240c8350 2024-01-27T14:32:28.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:28.425 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:28.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 msgr2=0x7f950406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 0x7f950406d3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9514036000 tx=0x7f9514008030 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 msgr2=0x7f9524149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e9b0 tx=0x7f950c00ee70 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 shutdown_connections 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f950406af20 0x7f950406d3e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95240c8350 0x7f9524149b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9524153a90 0x7f95240c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 --2- 172.21.15.46:0/2930449982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952406baf0 0x7f95241f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 >> 172.21.15.46:0/2930449982 conn(0x7f9524070e40 msgr2=0x7f9524158290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.430+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 shutdown_connections 2024-01-27T14:32:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.431+0000 7f9529f68640 1 -- 172.21.15.46:0/2930449982 wait complete. 2024-01-27T14:32:28.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-27T14:32:28.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:32:28.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.544+0000 7f3c5765d640 1 Processor -- start 2024-01-27T14:32:28.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.544+0000 7f3c5765d640 1 -- start start 2024-01-27T14:32:28.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.545+0000 7f3c5765d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.545+0000 7f3c5765d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 0x7f3c500b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.545+0000 7f3c5765d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c500b3280 con 0x7f3c50153b00 2024-01-27T14:32:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.545+0000 7f3c5765d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5015a8a0 con 0x7f3c500ca600 2024-01-27T14:32:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.545+0000 7f3c5765d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500b2ca0 con 0x7f3c500cf2c0 2024-01-27T14:32:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.546+0000 7f3c55bfa640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 0x7f3c500b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.546+0000 7f3c54bf8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.546+0000 7f3c55bfa640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 0x7f3c500b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56444/0 (socket says 172.21.15.46:56444) 2024-01-27T14:32:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.546+0000 7f3c55bfa640 1 -- 172.21.15.46:0/1383057376 learned_addr learned my addr 172.21.15.46:0/1383057376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.546+0000 7f3c54bf8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47436/0 (socket says 172.21.15.46:47436) 2024-01-27T14:32:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.549+0000 7f3c54bf8640 1 -- 172.21.15.46:0/1383057376 >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 msgr2=0x7f3c500b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.549+0000 7f3c54bf8640 1 --2- 172.21.15.46:0/1383057376 >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 0x7f3c500b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.549+0000 7f3c54bf8640 1 -- 172.21.15.46:0/1383057376 >> v1:172.21.15.73:6789/0 conn(0x7f3c50153b00 legacy=0x7f3c500cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.549+0000 7f3c54bf8640 1 -- 172.21.15.46:0/1383057376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5015d0d0 con 0x7f3c500cf2c0 2024-01-27T14:32:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.551+0000 7f3c54bf8640 1 --2- 172.21.15.46:0/1383057376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c440097a0 tx=0x7f3c4402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941b2e0ab86d53a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.554+0000 7f3c4ffff640 1 -- 172.21.15.46:0/1383057376 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44030610 con 0x7f3c500cf2c0 2024-01-27T14:32:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c4ffff640 1 -- 172.21.15.46:0/1383057376 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44030770 con 0x7f3c500cf2c0 2024-01-27T14:32:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c4ffff640 1 -- 172.21.15.46:0/1383057376 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44030b00 con 0x7f3c500cf2c0 2024-01-27T14:32:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 -- 172.21.15.46:0/1383057376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 msgr2=0x7f3c500ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 --2- 172.21.15.46:0/1383057376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c440097a0 tx=0x7f3c4402b960 comp rx=0 tx=0).stop 2024-01-27T14:32:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 -- 172.21.15.46:0/1383057376 shutdown_connections 2024-01-27T14:32:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 --2- 172.21.15.46:0/1383057376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500ca0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 --2- 172.21.15.46:0/1383057376 >> v2:172.21.15.73:3300/0 conn(0x7f3c500ca600 0x7f3c500b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 -- 172.21.15.46:0/1383057376 >> 172.21.15.46:0/1383057376 conn(0x7f3c5008b190 msgr2=0x7f3c5008b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 -- 172.21.15.46:0/1383057376 shutdown_connections 2024-01-27T14:32:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.555+0000 7f3c5765d640 1 -- 172.21.15.46:0/1383057376 wait complete. 2024-01-27T14:32:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.556+0000 7f3c5765d640 1 Processor -- start 2024-01-27T14:32:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.556+0000 7f3c5765d640 1 -- start start 2024-01-27T14:32:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 0x7f3c50156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c50153b00 0x7f3c5014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50154c20 con 0x7f3c50153b00 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501548c0 con 0x7f3c500ca600 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.557+0000 7f3c5765d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500b4a20 con 0x7f3c500cf2c0 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.558+0000 7f3c54bf8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.558+0000 7f3c55bfa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c50153b00 0x7f3c5014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.558+0000 7f3c553f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 0x7f3c50156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.558+0000 7f3c54bf8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47448/0 (socket says 172.21.15.46:47448) 2024-01-27T14:32:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.558+0000 7f3c54bf8640 1 -- 172.21.15.46:0/3544730987 learned_addr learned my addr 172.21.15.46:0/3544730987 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.561+0000 7f3c553f9640 1 -- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 msgr2=0x7f3c500cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.561+0000 7f3c553f9640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.561+0000 7f3c553f9640 1 -- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c50153b00 msgr2=0x7f3c5014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.561+0000 7f3c553f9640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c50153b00 0x7f3c5014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.561+0000 7f3c553f9640 1 -- 172.21.15.46:0/3544730987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009400 con 0x7f3c500ca600 2024-01-27T14:32:28.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.563+0000 7f3c553f9640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 0x7f3c50156fc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c3f0 tx=0x7f3c4800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.567+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480052d0 con 0x7f3c500ca600 2024-01-27T14:32:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.567+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48005450 con 0x7f3c500ca600 2024-01-27T14:32:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.567+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48007260 con 0x7f3c500ca600 2024-01-27T14:32:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.567+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c500c4e40 con 0x7f3c500ca600 2024-01-27T14:32:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.568+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c500c42c0 con 0x7f3c500ca600 2024-01-27T14:32:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.569+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c50157500 con 0x7f3c500ca600 2024-01-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.586+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3c480073c0 con 0x7f3c500ca600 2024-01-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.587+0000 7f3c4dffb640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 0x7f3c3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.587+0000 7f3c54bf8640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 0x7f3c3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.587+0000 7f3c54bf8640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 0x7f3c3c06d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c500c60d0 tx=0x7f3c44008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.590+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3c48057d40 con 0x7f3c500ca600 2024-01-27T14:32:28.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:28.821+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3c48054080 con 0x7f3c500ca600 2024-01-27T14:32:28.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.000+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c500b3630 con 0x7f3c3c06af00 2024-01-27T14:32:29.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.009+0000 7f3c4dffb640 1 -- 172.21.15.46:0/3544730987 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345293 (secure 0 0 0) 0x7f3c500b3630 con 0x7f3c3c06af00 2024-01-27T14:32:29.010 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:29.012 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 msgr2=0x7f3c3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 0x7f3c3c06d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c500c60d0 tx=0x7f3c44008030 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 msgr2=0x7f3c50156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 0x7f3c50156fc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c3f0 tx=0x7f3c4800c8b0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 shutdown_connections 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f3c3c06af00 0x7f3c3c06d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c50153b00 0x7f3c5014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c500cf2c0 0x7f3c500cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 --2- 172.21.15.46:0/3544730987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c500ca600 0x7f3c50156fc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 >> 172.21.15.46:0/3544730987 conn(0x7f3c5008b190 msgr2=0x7f3c501576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 shutdown_connections 2024-01-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.013+0000 7f3c5765d640 1 -- 172.21.15.46:0/3544730987 wait complete. 2024-01-27T14:32:29.020 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-01-27T14:32:27.008187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232280,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742440,"statfs":{"total":773094113280,"available":772856258560,"internally_reserved":0,"allocated":3710976,"data_stored":2190854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001947"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238588+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:32:21.238588+0000","last_peered":"2024-01-27T14:32:21.238588+0000","last_clean":"2024-01-27T14:32:21.238588+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:32:21.238588+0000","last_undegraded":"2024-01-27T14:32:21.238588+0000","last_fullsized":"2024-01-27T14:32:21.238588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651376+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:32:21.651376+0000","last_peered":"2024-01-27T14:32:21.651376+0000","last_clean":"2024-01-27T14:32:21.651376+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:32:21.651376+0000","last_undegraded":"2024-01-27T14:32:21.651376+0000","last_fullsized":"2024-01-27T14:32:21.651376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292974+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:32:21.292974+0000","last_peered":"2024-01-27T14:32:21.292974+0000","last_clean":"2024-01-27T14:32:21.292974+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:32:21.292974+0000","last_undegraded":"2024-01-27T14:32:21.292974+0000","last_fullsized":"2024-01-27T14:32:21.292974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651466+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:32:21.651466+0000","last_peered":"2024-01-27T14:32:21.651466+0000","last_clean":"2024-01-27T14:32:21.651466+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:32:21.651466+0000","last_undegraded":"2024-01-27T14:32:21.651466+0000","last_fullsized":"2024-01-27T14:32:21.651466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651384+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:32:21.651384+0000","last_peered":"2024-01-27T14:32:21.651384+0000","last_clean":"2024-01-27T14:32:21.651384+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:32:21.651384+0000","last_undegraded":"2024-01-27T14:32:21.651384+0000","last_fullsized":"2024-01-27T14:32:21.651384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294582+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:32:21.294582+0000","last_peered":"2024-01-27T14:32:21.294582+0000","last_clean":"2024-01-27T14:32:21.294582+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:32:21.294582+0000","last_undegraded":"2024-01-27T14:32:21.294582+0000","last_fullsized":"2024-01-27T14:32:21.294582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652816+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:32:21.652816+0000","last_peered":"2024-01-27T14:32:21.652816+0000","last_clean":"2024-01-27T14:32:21.652816+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:32:21.652816+0000","last_undegraded":"2024-01-27T14:32:21.652816+0000","last_fullsized":"2024-01-27T14:32:21.652816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241636+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:32:21.241636+0000","last_peered":"2024-01-27T14:32:21.241636+0000","last_clean":"2024-01-27T14:32:21.241636+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:32:21.241636+0000","last_undegraded":"2024-01-27T14:32:21.241636+0000","last_fullsized":"2024-01-27T14:32:21.241636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294900+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:32:21.294900+0000","last_peered":"2024-01-27T14:32:21.294900+0000","last_clean":"2024-01-27T14:32:21.294900+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:32:21.294900+0000","last_undegraded":"2024-01-27T14:32:21.294900+0000","last_fullsized":"2024-01-27T14:32:21.294900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652463+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:32:21.652463+0000","last_peered":"2024-01-27T14:32:21.652463+0000","last_clean":"2024-01-27T14:32:21.652463+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:32:21.652463+0000","last_undegraded":"2024-01-27T14:32:21.652463+0000","last_fullsized":"2024-01-27T14:32:21.652463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652524+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:32:21.652524+0000","last_peered":"2024-01-27T14:32:21.652524+0000","last_clean":"2024-01-27T14:32:21.652524+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:32:21.652524+0000","last_undegraded":"2024-01-27T14:32:21.652524+0000","last_fullsized":"2024-01-27T14:32:21.652524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294671+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:32:21.294671+0000","last_peered":"2024-01-27T14:32:21.294671+0000","last_clean":"2024-01-27T14:32:21.294671+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:32:21.294671+0000","last_undegraded":"2024-01-27T14:32:21.294671+0000","last_fullsized":"2024-01-27T14:32:21.294671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651544+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:32:21.651544+0000","last_peered":"2024-01-27T14:32:21.651544+0000","last_clean":"2024-01-27T14:32:21.651544+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:32:21.651544+0000","last_undegraded":"2024-01-27T14:32:21.651544+0000","last_fullsized":"2024-01-27T14:32:21.651544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652390+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:32:21.652390+0000","last_peered":"2024-01-27T14:32:21.652390+0000","last_clean":"2024-01-27T14:32:21.652390+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:32:21.652390+0000","last_undegraded":"2024-01-27T14:32:21.652390+0000","last_fullsized":"2024-01-27T14:32:21.652390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651027+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:32:21.651027+0000","last_peered":"2024-01-27T14:32:21.651027+0000","last_clean":"2024-01-27T14:32:21.651027+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:32:21.651027+0000","last_undegraded":"2024-01-27T14:32:21.651027+0000","last_fullsized":"2024-01-27T14:32:21.651027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293539+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:32:21.293539+0000","last_peered":"2024-01-27T14:32:21.293539+0000","last_clean":"2024-01-27T14:32:21.293539+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:32:21.293539+0000","last_undegraded":"2024-01-27T14:32:21.293539+0000","last_fullsized":"2024-01-27T14:32:21.293539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295065+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:32:21.295065+0000","last_peered":"2024-01-27T14:32:21.295065+0000","last_clean":"2024-01-27T14:32:21.295065+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:32:21.295065+0000","last_undegraded":"2024-01-27T14:32:21.295065+0000","last_fullsized":"2024-01-27T14:32:21.295065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651904+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:32:21.651904+0000","last_peered":"2024-01-27T14:32:21.651904+0000","last_clean":"2024-01-27T14:32:21.651904+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:32:21.651904+0000","last_undegraded":"2024-01-27T14:32:21.651904+0000","last_fullsized":"2024-01-27T14:32:21.651904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237570+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:32:21.237570+0000","last_peered":"2024-01-27T14:32:21.237570+0000","last_clean":"2024-01-27T14:32:21.237570+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:32:21.237570+0000","last_undegraded":"2024-01-27T14:32:21.237570+0000","last_fullsized":"2024-01-27T14:32:21.237570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237852+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:32:21.237852+0000","last_peered":"2024-01-27T14:32:21.237852+0000","last_clean":"2024-01-27T14:32:21.237852+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:32:21.237852+0000","last_undegraded":"2024-01-27T14:32:21.237852+0000","last_fullsized":"2024-01-27T14:32:21.237852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294096+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:32:21.294096+0000","last_peered":"2024-01-27T14:32:21.294096+0000","last_clean":"2024-01-27T14:32:21.294096+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:32:21.294096+0000","last_undegraded":"2024-01-27T14:32:21.294096+0000","last_fullsized":"2024-01-27T14:32:21.294096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651865+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:32:21.651865+0000","last_peered":"2024-01-27T14:32:21.651865+0000","last_clean":"2024-01-27T14:32:21.651865+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:32:21.651865+0000","last_undegraded":"2024-01-27T14:32:21.651865+0000","last_fullsized":"2024-01-27T14:32:21.651865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651467+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:32:21.651467+0000","last_peered":"2024-01-27T14:32:21.651467+0000","last_clean":"2024-01-27T14:32:21.651467+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:32:21.651467+0000","last_undegraded":"2024-01-27T14:32:21.651467+0000","last_fullsized":"2024-01-27T14:32:21.651467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295394+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:32:21.295394+0000","last_peered":"2024-01-27T14:32:21.295394+0000","last_clean":"2024-01-27T14:32:21.295394+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:32:21.295394+0000","last_undegraded":"2024-01-27T14:32:21.295394+0000","last_fullsized":"2024-01-27T14:32:21.295394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238196+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:32:21.238196+0000","last_peered":"2024-01-27T14:32:21.238196+0000","last_clean":"2024-01-27T14:32:21.238196+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:32:21.238196+0000","last_undegraded":"2024-01-27T14:32:21.238196+0000","last_fullsized":"2024-01-27T14:32:21.238196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652266+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:32:21.652266+0000","last_peered":"2024-01-27T14:32:21.652266+0000","last_clean":"2024-01-27T14:32:21.652266+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:32:21.652266+0000","last_undegraded":"2024-01-27T14:32:21.652266+0000","last_fullsized":"2024-01-27T14:32:21.652266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294635+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:32:21.294635+0000","last_peered":"2024-01-27T14:32:21.294635+0000","last_clean":"2024-01-27T14:32:21.294635+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:32:21.294635+0000","last_undegraded":"2024-01-27T14:32:21.294635+0000","last_fullsized":"2024-01-27T14:32:21.294635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238451+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:32:21.238451+0000","last_peered":"2024-01-27T14:32:21.238451+0000","last_clean":"2024-01-27T14:32:21.238451+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:32:21.238451+0000","last_undegraded":"2024-01-27T14:32:21.238451+0000","last_fullsized":"2024-01-27T14:32:21.238451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238393+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:32:21.238393+0000","last_peered":"2024-01-27T14:32:21.238393+0000","last_clean":"2024-01-27T14:32:21.238393+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:32:21.238393+0000","last_undegraded":"2024-01-27T14:32:21.238393+0000","last_fullsized":"2024-01-27T14:32:21.238393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237454+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:32:21.237454+0000","last_peered":"2024-01-27T14:32:21.237454+0000","last_clean":"2024-01-27T14:32:21.237454+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:32:21.237454+0000","last_undegraded":"2024-01-27T14:32:21.237454+0000","last_fullsized":"2024-01-27T14:32:21.237454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295251+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:32:21.295251+0000","last_peered":"2024-01-27T14:32:21.295251+0000","last_clean":"2024-01-27T14:32:21.295251+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:32:21.295251+0000","last_undegraded":"2024-01-27T14:32:21.295251+0000","last_fullsized":"2024-01-27T14:32:21.295251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651733+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:32:21.651733+0000","last_peered":"2024-01-27T14:32:21.651733+0000","last_clean":"2024-01-27T14:32:21.651733+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:32:21.651733+0000","last_undegraded":"2024-01-27T14:32:21.651733+0000","last_fullsized":"2024-01-27T14:32:21.651733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294883+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:32:21.294883+0000","last_peered":"2024-01-27T14:32:21.294883+0000","last_clean":"2024-01-27T14:32:21.294883+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:32:21.294883+0000","last_undegraded":"2024-01-27T14:32:21.294883+0000","last_fullsized":"2024-01-27T14:32:21.294883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295239+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:32:21.295239+0000","last_peered":"2024-01-27T14:32:21.295239+0000","last_clean":"2024-01-27T14:32:21.295239+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:32:21.295239+0000","last_undegraded":"2024-01-27T14:32:21.295239+0000","last_fullsized":"2024-01-27T14:32:21.295239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651065+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:32:21.651065+0000","last_peered":"2024-01-27T14:32:21.651065+0000","last_clean":"2024-01-27T14:32:21.651065+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:32:21.651065+0000","last_undegraded":"2024-01-27T14:32:21.651065+0000","last_fullsized":"2024-01-27T14:32:21.651065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294731+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:32:21.294731+0000","last_peered":"2024-01-27T14:32:21.294731+0000","last_clean":"2024-01-27T14:32:21.294731+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:32:21.294731+0000","last_undegraded":"2024-01-27T14:32:21.294731+0000","last_fullsized":"2024-01-27T14:32:21.294731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652309+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:32:21.652309+0000","last_peered":"2024-01-27T14:32:21.652309+0000","last_clean":"2024-01-27T14:32:21.652309+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:32:21.652309+0000","last_undegraded":"2024-01-27T14:32:21.652309+0000","last_fullsized":"2024-01-27T14:32:21.652309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652180+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:32:21.652180+0000","last_peered":"2024-01-27T14:32:21.652180+0000","last_clean":"2024-01-27T14:32:21.652180+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:32:21.652180+0000","last_undegraded":"2024-01-27T14:32:21.652180+0000","last_fullsized":"2024-01-27T14:32:21.652180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654208+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:32:21.654208+0000","last_peered":"2024-01-27T14:32:21.654208+0000","last_clean":"2024-01-27T14:32:21.654208+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:32:21.654208+0000","last_undegraded":"2024-01-27T14:32:21.654208+0000","last_fullsized":"2024-01-27T14:32:21.654208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650497+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:32:21.650497+0000","last_peered":"2024-01-27T14:32:21.650497+0000","last_clean":"2024-01-27T14:32:21.650497+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:32:21.650497+0000","last_undegraded":"2024-01-27T14:32:21.650497+0000","last_fullsized":"2024-01-27T14:32:21.650497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293110+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:32:21.293110+0000","last_peered":"2024-01-27T14:32:21.293110+0000","last_clean":"2024-01-27T14:32:21.293110+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:32:21.293110+0000","last_undegraded":"2024-01-27T14:32:21.293110+0000","last_fullsized":"2024-01-27T14:32:21.293110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295213+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:32:21.295213+0000","last_peered":"2024-01-27T14:32:21.295213+0000","last_clean":"2024-01-27T14:32:21.295213+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:32:21.295213+0000","last_undegraded":"2024-01-27T14:32:21.295213+0000","last_fullsized":"2024-01-27T14:32:21.295213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294709+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:32:21.294709+0000","last_peered":"2024-01-27T14:32:21.294709+0000","last_clean":"2024-01-27T14:32:21.294709+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:32:21.294709+0000","last_undegraded":"2024-01-27T14:32:21.294709+0000","last_fullsized":"2024-01-27T14:32:21.294709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651991+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:32:21.651991+0000","last_peered":"2024-01-27T14:32:21.651991+0000","last_clean":"2024-01-27T14:32:21.651991+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:32:21.651991+0000","last_undegraded":"2024-01-27T14:32:21.651991+0000","last_fullsized":"2024-01-27T14:32:21.651991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651175+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:32:21.651175+0000","last_peered":"2024-01-27T14:32:21.651175+0000","last_clean":"2024-01-27T14:32:21.651175+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:32:21.651175+0000","last_undegraded":"2024-01-27T14:32:21.651175+0000","last_fullsized":"2024-01-27T14:32:21.651175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237816+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:32:21.237816+0000","last_peered":"2024-01-27T14:32:21.237816+0000","last_clean":"2024-01-27T14:32:21.237816+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:32:21.237816+0000","last_undegraded":"2024-01-27T14:32:21.237816+0000","last_fullsized":"2024-01-27T14:32:21.237816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652451+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:32:21.652451+0000","last_peered":"2024-01-27T14:32:21.652451+0000","last_clean":"2024-01-27T14:32:21.652451+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:32:21.652451+0000","last_undegraded":"2024-01-27T14:32:21.652451+0000","last_fullsized":"2024-01-27T14:32:21.652451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241460+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:32:21.241460+0000","last_peered":"2024-01-27T14:32:21.241460+0000","last_clean":"2024-01-27T14:32:21.241460+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:32:21.241460+0000","last_undegraded":"2024-01-27T14:32:21.241460+0000","last_fullsized":"2024-01-27T14:32:21.241460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651549+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:32:21.651549+0000","last_peered":"2024-01-27T14:32:21.651549+0000","last_clean":"2024-01-27T14:32:21.651549+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:32:21.651549+0000","last_undegraded":"2024-01-27T14:32:21.651549+0000","last_fullsized":"2024-01-27T14:32:21.651549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651447+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:32:21.651447+0000","last_peered":"2024-01-27T14:32:21.651447+0000","last_clean":"2024-01-27T14:32:21.651447+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:32:21.651447+0000","last_undegraded":"2024-01-27T14:32:21.651447+0000","last_fullsized":"2024-01-27T14:32:21.651447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295338+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:32:21.295338+0000","last_peered":"2024-01-27T14:32:21.295338+0000","last_clean":"2024-01-27T14:32:21.295338+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:32:21.295338+0000","last_undegraded":"2024-01-27T14:32:21.295338+0000","last_fullsized":"2024-01-27T14:32:21.295338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294745+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:32:21.294745+0000","last_peered":"2024-01-27T14:32:21.294745+0000","last_clean":"2024-01-27T14:32:21.294745+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:32:21.294745+0000","last_undegraded":"2024-01-27T14:32:21.294745+0000","last_fullsized":"2024-01-27T14:32:21.294745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652358+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:32:21.652358+0000","last_peered":"2024-01-27T14:32:21.652358+0000","last_clean":"2024-01-27T14:32:21.652358+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:32:21.652358+0000","last_undegraded":"2024-01-27T14:32:21.652358+0000","last_fullsized":"2024-01-27T14:32:21.652358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651226+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:32:21.651226+0000","last_peered":"2024-01-27T14:32:21.651226+0000","last_clean":"2024-01-27T14:32:21.651226+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:32:21.651226+0000","last_undegraded":"2024-01-27T14:32:21.651226+0000","last_fullsized":"2024-01-27T14:32:21.651226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650897+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:32:21.650897+0000","last_peered":"2024-01-27T14:32:21.650897+0000","last_clean":"2024-01-27T14:32:21.650897+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:32:21.650897+0000","last_undegraded":"2024-01-27T14:32:21.650897+0000","last_fullsized":"2024-01-27T14:32:21.650897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652032+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:32:21.652032+0000","last_peered":"2024-01-27T14:32:21.652032+0000","last_clean":"2024-01-27T14:32:21.652032+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:32:21.652032+0000","last_undegraded":"2024-01-27T14:32:21.652032+0000","last_fullsized":"2024-01-27T14:32:21.652032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238292+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:32:21.238292+0000","last_peered":"2024-01-27T14:32:21.238292+0000","last_clean":"2024-01-27T14:32:21.238292+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:32:21.238292+0000","last_undegraded":"2024-01-27T14:32:21.238292+0000","last_fullsized":"2024-01-27T14:32:21.238292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651571+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:32:21.651571+0000","last_peered":"2024-01-27T14:32:21.651571+0000","last_clean":"2024-01-27T14:32:21.651571+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:32:21.651571+0000","last_undegraded":"2024-01-27T14:32:21.651571+0000","last_fullsized":"2024-01-27T14:32:21.651571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295584+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:32:21.295584+0000","last_peered":"2024-01-27T14:32:21.295584+0000","last_clean":"2024-01-27T14:32:21.295584+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:32:21.295584+0000","last_undegraded":"2024-01-27T14:32:21.295584+0000","last_fullsized":"2024-01-27T14:32:21.295584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652135+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:32:21.652135+0000","last_peered":"2024-01-27T14:32:21.652135+0000","last_clean":"2024-01-27T14:32:21.652135+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:32:21.652135+0000","last_undegraded":"2024-01-27T14:32:21.652135+0000","last_fullsized":"2024-01-27T14:32:21.652135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241389+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:32:21.241389+0000","last_peered":"2024-01-27T14:32:21.241389+0000","last_clean":"2024-01-27T14:32:21.241389+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:32:21.241389+0000","last_undegraded":"2024-01-27T14:32:21.241389+0000","last_fullsized":"2024-01-27T14:32:21.241389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651770+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:32:21.651770+0000","last_peered":"2024-01-27T14:32:21.651770+0000","last_clean":"2024-01-27T14:32:21.651770+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:32:21.651770+0000","last_undegraded":"2024-01-27T14:32:21.651770+0000","last_fullsized":"2024-01-27T14:32:21.651770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237581+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:32:21.237581+0000","last_peered":"2024-01-27T14:32:21.237581+0000","last_clean":"2024-01-27T14:32:21.237581+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:32:21.237581+0000","last_undegraded":"2024-01-27T14:32:21.237581+0000","last_fullsized":"2024-01-27T14:32:21.237581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651327+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:32:21.651327+0000","last_peered":"2024-01-27T14:32:21.651327+0000","last_clean":"2024-01-27T14:32:21.651327+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:32:21.651327+0000","last_undegraded":"2024-01-27T14:32:21.651327+0000","last_fullsized":"2024-01-27T14:32:21.651327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241363+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:32:21.241363+0000","last_peered":"2024-01-27T14:32:21.241363+0000","last_clean":"2024-01-27T14:32:21.241363+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:32:21.241363+0000","last_undegraded":"2024-01-27T14:32:21.241363+0000","last_fullsized":"2024-01-27T14:32:21.241363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651913+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:32:21.651913+0000","last_peered":"2024-01-27T14:32:21.651913+0000","last_clean":"2024-01-27T14:32:21.651913+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:32:21.651913+0000","last_undegraded":"2024-01-27T14:32:21.651913+0000","last_fullsized":"2024-01-27T14:32:21.651913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651305+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:32:21.651305+0000","last_peered":"2024-01-27T14:32:21.651305+0000","last_clean":"2024-01-27T14:32:21.651305+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:32:21.651305+0000","last_undegraded":"2024-01-27T14:32:21.651305+0000","last_fullsized":"2024-01-27T14:32:21.651305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652240+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:32:21.652240+0000","last_peered":"2024-01-27T14:32:21.652240+0000","last_clean":"2024-01-27T14:32:21.652240+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:32:21.652240+0000","last_undegraded":"2024-01-27T14:32:21.652240+0000","last_fullsized":"2024-01-27T14:32:21.652240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652092+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:32:21.652092+0000","last_peered":"2024-01-27T14:32:21.652092+0000","last_clean":"2024-01-27T14:32:21.652092+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:32:21.652092+0000","last_undegraded":"2024-01-27T14:32:21.652092+0000","last_fullsized":"2024-01-27T14:32:21.652092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294990+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:32:21.294990+0000","last_peered":"2024-01-27T14:32:21.294990+0000","last_clean":"2024-01-27T14:32:21.294990+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:32:21.294990+0000","last_undegraded":"2024-01-27T14:32:21.294990+0000","last_fullsized":"2024-01-27T14:32:21.294990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294975+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:32:21.294975+0000","last_peered":"2024-01-27T14:32:21.294975+0000","last_clean":"2024-01-27T14:32:21.294975+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.294975+0000","last_undegraded":"2024-01-27T14:32:21.294975+0000","last_fullsized":"2024-01-27T14:32:21.294975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294068+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:32:21.294068+0000","last_peered":"2024-01-27T14:32:21.294068+0000","last_clean":"2024-01-27T14:32:21.294068+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:32:21.294068+0000","last_undegraded":"2024-01-27T14:32:21.294068+0000","last_fullsized":"2024-01-27T14:32:21.294068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.655214+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:32:21.655214+0000","last_peered":"2024-01-27T14:32:21.655214+0000","last_clean":"2024-01-27T14:32:21.655214+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:32:21.655214+0000","last_undegraded":"2024-01-27T14:32:21.655214+0000","last_fullsized":"2024-01-27T14:32:21.655214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652753+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:32:21.652753+0000","last_peered":"2024-01-27T14:32:21.652753+0000","last_clean":"2024-01-27T14:32:21.652753+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:32:21.652753+0000","last_undegraded":"2024-01-27T14:32:21.652753+0000","last_fullsized":"2024-01-27T14:32:21.652753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295088+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:32:21.295088+0000","last_peered":"2024-01-27T14:32:21.295088+0000","last_clean":"2024-01-27T14:32:21.295088+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:32:21.295088+0000","last_undegraded":"2024-01-27T14:32:21.295088+0000","last_fullsized":"2024-01-27T14:32:21.295088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237928+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:32:21.237928+0000","last_peered":"2024-01-27T14:32:21.237928+0000","last_clean":"2024-01-27T14:32:21.237928+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:32:21.237928+0000","last_undegraded":"2024-01-27T14:32:21.237928+0000","last_fullsized":"2024-01-27T14:32:21.237928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651594+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:32:21.651594+0000","last_peered":"2024-01-27T14:32:21.651594+0000","last_clean":"2024-01-27T14:32:21.651594+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:32:21.651594+0000","last_undegraded":"2024-01-27T14:32:21.651594+0000","last_fullsized":"2024-01-27T14:32:21.651594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293773+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:32:21.293773+0000","last_peered":"2024-01-27T14:32:21.293773+0000","last_clean":"2024-01-27T14:32:21.293773+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:32:21.293773+0000","last_undegraded":"2024-01-27T14:32:21.293773+0000","last_fullsized":"2024-01-27T14:32:21.293773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294920+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:32:21.294920+0000","last_peered":"2024-01-27T14:32:21.294920+0000","last_clean":"2024-01-27T14:32:21.294920+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:32:21.294920+0000","last_undegraded":"2024-01-27T14:32:21.294920+0000","last_fullsized":"2024-01-27T14:32:21.294920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651487+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:32:21.651487+0000","last_peered":"2024-01-27T14:32:21.651487+0000","last_clean":"2024-01-27T14:32:21.651487+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:32:21.651487+0000","last_undegraded":"2024-01-27T14:32:21.651487+0000","last_fullsized":"2024-01-27T14:32:21.651487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652785+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:32:21.652785+0000","last_peered":"2024-01-27T14:32:21.652785+0000","last_clean":"2024-01-27T14:32:21.652785+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:32:21.652785+0000","last_undegraded":"2024-01-27T14:32:21.652785+0000","last_fullsized":"2024-01-27T14:32:21.652785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292926+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:32:21.292926+0000","last_peered":"2024-01-27T14:32:21.292926+0000","last_clean":"2024-01-27T14:32:21.292926+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:32:21.292926+0000","last_undegraded":"2024-01-27T14:32:21.292926+0000","last_fullsized":"2024-01-27T14:32:21.292926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295496+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:32:21.295496+0000","last_peered":"2024-01-27T14:32:21.295496+0000","last_clean":"2024-01-27T14:32:21.295496+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:32:21.295496+0000","last_undegraded":"2024-01-27T14:32:21.295496+0000","last_fullsized":"2024-01-27T14:32:21.295496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.242122+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:32:21.242122+0000","last_peered":"2024-01-27T14:32:21.242122+0000","last_clean":"2024-01-27T14:32:21.242122+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:32:21.242122+0000","last_undegraded":"2024-01-27T14:32:21.242122+0000","last_fullsized":"2024-01-27T14:32:21.242122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237746+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:32:21.237746+0000","last_peered":"2024-01-27T14:32:21.237746+0000","last_clean":"2024-01-27T14:32:21.237746+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:32:21.237746+0000","last_undegraded":"2024-01-27T14:32:21.237746+0000","last_fullsized":"2024-01-27T14:32:21.237746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654246+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:32:21.654246+0000","last_peered":"2024-01-27T14:32:21.654246+0000","last_clean":"2024-01-27T14:32:21.654246+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:32:21.654246+0000","last_undegraded":"2024-01-27T14:32:21.654246+0000","last_fullsized":"2024-01-27T14:32:21.654246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237784+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:32:21.237784+0000","last_peered":"2024-01-27T14:32:21.237784+0000","last_clean":"2024-01-27T14:32:21.237784+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:32:21.237784+0000","last_undegraded":"2024-01-27T14:32:21.237784+0000","last_fullsized":"2024-01-27T14:32:21.237784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651897+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:32:21.651897+0000","last_peered":"2024-01-27T14:32:21.651897+0000","last_clean":"2024-01-27T14:32:21.651897+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:32:21.651897+0000","last_undegraded":"2024-01-27T14:32:21.651897+0000","last_fullsized":"2024-01-27T14:32:21.651897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652002+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:32:21.652002+0000","last_peered":"2024-01-27T14:32:21.652002+0000","last_clean":"2024-01-27T14:32:21.652002+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:32:21.652002+0000","last_undegraded":"2024-01-27T14:32:21.652002+0000","last_fullsized":"2024-01-27T14:32:21.652002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650619+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:32:21.650619+0000","last_peered":"2024-01-27T14:32:21.650619+0000","last_clean":"2024-01-27T14:32:21.650619+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:32:21.650619+0000","last_undegraded":"2024-01-27T14:32:21.650619+0000","last_fullsized":"2024-01-27T14:32:21.650619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294713+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:32:21.294713+0000","last_peered":"2024-01-27T14:32:21.294713+0000","last_clean":"2024-01-27T14:32:21.294713+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:32:21.294713+0000","last_undegraded":"2024-01-27T14:32:21.294713+0000","last_fullsized":"2024-01-27T14:32:21.294713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652482+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:32:21.652482+0000","last_peered":"2024-01-27T14:32:21.652482+0000","last_clean":"2024-01-27T14:32:21.652482+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:32:21.652482+0000","last_undegraded":"2024-01-27T14:32:21.652482+0000","last_fullsized":"2024-01-27T14:32:21.652482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237832+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:32:21.237832+0000","last_peered":"2024-01-27T14:32:21.237832+0000","last_clean":"2024-01-27T14:32:21.237832+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:32:21.237832+0000","last_undegraded":"2024-01-27T14:32:21.237832+0000","last_fullsized":"2024-01-27T14:32:21.237832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237968+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:32:21.237968+0000","last_peered":"2024-01-27T14:32:21.237968+0000","last_clean":"2024-01-27T14:32:21.237968+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:32:21.237968+0000","last_undegraded":"2024-01-27T14:32:21.237968+0000","last_fullsized":"2024-01-27T14:32:21.237968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651079+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:32:21.651079+0000","last_peered":"2024-01-27T14:32:21.651079+0000","last_clean":"2024-01-27T14:32:21.651079+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:32:21.651079+0000","last_undegraded":"2024-01-27T14:32:21.651079+0000","last_fullsized":"2024-01-27T14:32:21.651079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241561+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:32:21.241561+0000","last_peered":"2024-01-27T14:32:21.241561+0000","last_clean":"2024-01-27T14:32:21.241561+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:32:21.241561+0000","last_undegraded":"2024-01-27T14:32:21.241561+0000","last_fullsized":"2024-01-27T14:32:21.241561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293607+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:32:21.293607+0000","last_peered":"2024-01-27T14:32:21.293607+0000","last_clean":"2024-01-27T14:32:21.293607+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:32:21.293607+0000","last_undegraded":"2024-01-27T14:32:21.293607+0000","last_fullsized":"2024-01-27T14:32:21.293607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294584+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:32:21.294584+0000","last_peered":"2024-01-27T14:32:21.294584+0000","last_clean":"2024-01-27T14:32:21.294584+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:32:21.294584+0000","last_undegraded":"2024-01-27T14:32:21.294584+0000","last_fullsized":"2024-01-27T14:32:21.294584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293063+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:32:21.293063+0000","last_peered":"2024-01-27T14:32:21.293063+0000","last_clean":"2024-01-27T14:32:21.293063+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:32:21.293063+0000","last_undegraded":"2024-01-27T14:32:21.293063+0000","last_fullsized":"2024-01-27T14:32:21.293063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651459+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:32:21.651459+0000","last_peered":"2024-01-27T14:32:21.651459+0000","last_clean":"2024-01-27T14:32:21.651459+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:32:21.651459+0000","last_undegraded":"2024-01-27T14:32:21.651459+0000","last_fullsized":"2024-01-27T14:32:21.651459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650996+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:32:21.650996+0000","last_peered":"2024-01-27T14:32:21.650996+0000","last_clean":"2024-01-27T14:32:21.650996+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:32:21.650996+0000","last_undegraded":"2024-01-27T14:32:21.650996+0000","last_fullsized":"2024-01-27T14:32:21.650996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295167+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:32:21.295167+0000","last_peered":"2024-01-27T14:32:21.295167+0000","last_clean":"2024-01-27T14:32:21.295167+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:32:21.295167+0000","last_undegraded":"2024-01-27T14:32:21.295167+0000","last_fullsized":"2024-01-27T14:32:21.295167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295361+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:32:21.295361+0000","last_peered":"2024-01-27T14:32:21.295361+0000","last_clean":"2024-01-27T14:32:21.295361+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:32:21.295361+0000","last_undegraded":"2024-01-27T14:32:21.295361+0000","last_fullsized":"2024-01-27T14:32:21.295361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295399+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:32:21.295399+0000","last_peered":"2024-01-27T14:32:21.295399+0000","last_clean":"2024-01-27T14:32:21.295399+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:32:21.295399+0000","last_undegraded":"2024-01-27T14:32:21.295399+0000","last_fullsized":"2024-01-27T14:32:21.295399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651227+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:32:21.651227+0000","last_peered":"2024-01-27T14:32:21.651227+0000","last_clean":"2024-01-27T14:32:21.651227+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:32:21.651227+0000","last_undegraded":"2024-01-27T14:32:21.651227+0000","last_fullsized":"2024-01-27T14:32:21.651227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651809+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:32:21.651809+0000","last_peered":"2024-01-27T14:32:21.651809+0000","last_clean":"2024-01-27T14:32:21.651809+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:32:21.651809+0000","last_undegraded":"2024-01-27T14:32:21.651809+0000","last_fullsized":"2024-01-27T14:32:21.651809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650583+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:32:21.650583+0000","last_peered":"2024-01-27T14:32:21.650583+0000","last_clean":"2024-01-27T14:32:21.650583+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:32:21.650583+0000","last_undegraded":"2024-01-27T14:32:21.650583+0000","last_fullsized":"2024-01-27T14:32:21.650583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241509+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:32:21.241509+0000","last_peered":"2024-01-27T14:32:21.241509+0000","last_clean":"2024-01-27T14:32:21.241509+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.241509+0000","last_undegraded":"2024-01-27T14:32:21.241509+0000","last_fullsized":"2024-01-27T14:32:21.241509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237731+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:32:21.237731+0000","last_peered":"2024-01-27T14:32:21.237731+0000","last_clean":"2024-01-27T14:32:21.237731+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:32:21.237731+0000","last_undegraded":"2024-01-27T14:32:21.237731+0000","last_fullsized":"2024-01-27T14:32:21.237731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652272+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:32:21.652272+0000","last_peered":"2024-01-27T14:32:21.652272+0000","last_clean":"2024-01-27T14:32:21.652272+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:32:21.652272+0000","last_undegraded":"2024-01-27T14:32:21.652272+0000","last_fullsized":"2024-01-27T14:32:21.652272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651644+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:32:21.651644+0000","last_peered":"2024-01-27T14:32:21.651644+0000","last_clean":"2024-01-27T14:32:21.651644+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:32:21.651644+0000","last_undegraded":"2024-01-27T14:32:21.651644+0000","last_fullsized":"2024-01-27T14:32:21.651644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293934+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:32:21.293934+0000","last_peered":"2024-01-27T14:32:21.293934+0000","last_clean":"2024-01-27T14:32:21.293934+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:32:21.293934+0000","last_undegraded":"2024-01-27T14:32:21.293934+0000","last_fullsized":"2024-01-27T14:32:21.293934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652172+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:32:21.652172+0000","last_peered":"2024-01-27T14:32:21.652172+0000","last_clean":"2024-01-27T14:32:21.652172+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:32:21.652172+0000","last_undegraded":"2024-01-27T14:32:21.652172+0000","last_fullsized":"2024-01-27T14:32:21.652172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651716+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:32:21.651716+0000","last_peered":"2024-01-27T14:32:21.651716+0000","last_clean":"2024-01-27T14:32:21.651716+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:32:21.651716+0000","last_undegraded":"2024-01-27T14:32:21.651716+0000","last_fullsized":"2024-01-27T14:32:21.651716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650693+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:32:21.650693+0000","last_peered":"2024-01-27T14:32:21.650693+0000","last_clean":"2024-01-27T14:32:21.650693+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:32:21.650693+0000","last_undegraded":"2024-01-27T14:32:21.650693+0000","last_fullsized":"2024-01-27T14:32:21.650693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294879+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:32:21.294879+0000","last_peered":"2024-01-27T14:32:21.294879+0000","last_clean":"2024-01-27T14:32:21.294879+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:32:21.294879+0000","last_undegraded":"2024-01-27T14:32:21.294879+0000","last_fullsized":"2024-01-27T14:32:21.294879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295073+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:32:21.295073+0000","last_peered":"2024-01-27T14:32:21.295073+0000","last_clean":"2024-01-27T14:32:21.295073+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:32:21.295073+0000","last_undegraded":"2024-01-27T14:32:21.295073+0000","last_fullsized":"2024-01-27T14:32:21.295073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652186+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:32:21.652186+0000","last_peered":"2024-01-27T14:32:21.652186+0000","last_clean":"2024-01-27T14:32:21.652186+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:32:21.652186+0000","last_undegraded":"2024-01-27T14:32:21.652186+0000","last_fullsized":"2024-01-27T14:32:21.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652698+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:32:21.652698+0000","last_peered":"2024-01-27T14:32:21.652698+0000","last_clean":"2024-01-27T14:32:21.652698+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:32:21.652698+0000","last_undegraded":"2024-01-27T14:32:21.652698+0000","last_fullsized":"2024-01-27T14:32:21.652698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652572+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:32:21.652572+0000","last_peered":"2024-01-27T14:32:21.652572+0000","last_clean":"2024-01-27T14:32:21.652572+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:32:21.652572+0000","last_undegraded":"2024-01-27T14:32:21.652572+0000","last_fullsized":"2024-01-27T14:32:21.652572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241969+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:32:21.241969+0000","last_peered":"2024-01-27T14:32:21.241969+0000","last_clean":"2024-01-27T14:32:21.241969+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:32:21.241969+0000","last_undegraded":"2024-01-27T14:32:21.241969+0000","last_fullsized":"2024-01-27T14:32:21.241969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650428+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:32:21.650428+0000","last_peered":"2024-01-27T14:32:21.650428+0000","last_clean":"2024-01-27T14:32:21.650428+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:32:21.650428+0000","last_undegraded":"2024-01-27T14:32:21.650428+0000","last_fullsized":"2024-01-27T14:32:21.650428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651824+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:32:21.651824+0000","last_peered":"2024-01-27T14:32:21.651824+0000","last_clean":"2024-01-27T14:32:21.651824+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:32:21.651824+0000","last_undegraded":"2024-01-27T14:32:21.651824+0000","last_fullsized":"2024-01-27T14:32:21.651824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294824+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:32:21.294824+0000","last_peered":"2024-01-27T14:32:21.294824+0000","last_clean":"2024-01-27T14:32:21.294824+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:32:21.294824+0000","last_undegraded":"2024-01-27T14:32:21.294824+0000","last_fullsized":"2024-01-27T14:32:21.294824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654122+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:32:21.654122+0000","last_peered":"2024-01-27T14:32:21.654122+0000","last_clean":"2024-01-27T14:32:21.654122+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:32:21.654122+0000","last_undegraded":"2024-01-27T14:32:21.654122+0000","last_fullsized":"2024-01-27T14:32:21.654122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294919+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:32:21.294919+0000","last_peered":"2024-01-27T14:32:21.294919+0000","last_clean":"2024-01-27T14:32:21.294919+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:32:21.294919+0000","last_undegraded":"2024-01-27T14:32:21.294919+0000","last_fullsized":"2024-01-27T14:32:21.294919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651126+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:32:21.651126+0000","last_peered":"2024-01-27T14:32:21.651126+0000","last_clean":"2024-01-27T14:32:21.651126+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:32:21.651126+0000","last_undegraded":"2024-01-27T14:32:21.651126+0000","last_fullsized":"2024-01-27T14:32:21.651126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651251+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:32:21.651251+0000","last_peered":"2024-01-27T14:32:21.651251+0000","last_clean":"2024-01-27T14:32:21.651251+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:32:21.651251+0000","last_undegraded":"2024-01-27T14:32:21.651251+0000","last_fullsized":"2024-01-27T14:32:21.651251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651939+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:32:21.651939+0000","last_peered":"2024-01-27T14:32:21.651939+0000","last_clean":"2024-01-27T14:32:21.651939+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:32:21.651939+0000","last_undegraded":"2024-01-27T14:32:21.651939+0000","last_fullsized":"2024-01-27T14:32:21.651939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":125229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":715565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":128946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":715543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":125161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":125105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":129618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:32:29.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:32:29.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.165+0000 7fefa682b640 1 Processor -- start 2024-01-27T14:32:29.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.165+0000 7fefa682b640 1 -- start start 2024-01-27T14:32:29.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.166+0000 7fefa682b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa00c9910 0x7fefa00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.166+0000 7fefa682b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fefa00cf7c0 0x7fefa015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.166+0000 7fefa682b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa00c4ee0 con 0x7fefa0153ac0 2024-01-27T14:32:29.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.166+0000 7fefa682b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa00c5230 con 0x7fefa00cf7c0 2024-01-27T14:32:29.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.166+0000 7fefa682b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00c9d50 con 0x7fefa00c9910 2024-01-27T14:32:29.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.167+0000 7fef9ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fefa0153ac0 0x7fefa015d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57288/0 (socket says 172.21.15.46:57288) 2024-01-27T14:32:29.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.167+0000 7fef9ffff640 1 -- 172.21.15.46:0/1434605471 learned_addr learned my addr 172.21.15.46:0/1434605471 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.167+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa00c9910 0x7fefa00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.167+0000 7fefa4dc8640 1 --2- 172.21.15.46:0/1434605471 >> v2:172.21.15.73:3300/0 conn(0x7fefa00cf7c0 0x7fefa015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.169+0000 7fefa4dc8640 1 -- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa00c9910 msgr2=0x7fefa00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:29.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.169+0000 7fefa4dc8640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa00c9910 0x7fefa00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.169+0000 7fefa4dc8640 1 -- 172.21.15.46:0/1434605471 >> v1:172.21.15.46:6789/0 conn(0x7fefa0153ac0 legacy=0x7fefa015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.169+0000 7fefa4dc8640 1 -- 172.21.15.46:0/1434605471 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0153ea0 con 0x7fefa00cf7c0 2024-01-27T14:32:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.171+0000 7fefa4dc8640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa015acd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5266225695198b9f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:29.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.175+0000 7fef9effd640 1 -- 172.21.15.46:0/1434605471 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9802cce0 con 0x7fefa00cf7c0 2024-01-27T14:32:29.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.175+0000 7fef9effd640 1 -- 172.21.15.46:0/1434605471 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9802ce40 con 0x7fefa00cf7c0 2024-01-27T14:32:29.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.175+0000 7fef9effd640 1 -- 172.21.15.46:0/1434605471 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98034660 con 0x7fefa00cf7c0 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 -- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 msgr2=0x7fefa015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa015acd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9802bf30 comp rx=0 tx=0).stop 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 -- 172.21.15.46:0/1434605471 shutdown_connections 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa00c9910 0x7fefa00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 --2- 172.21.15.46:0/1434605471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa015acd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 -- 172.21.15.46:0/1434605471 >> 172.21.15.46:0/1434605471 conn(0x7fefa006cca0 msgr2=0x7fefa006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 -- 172.21.15.46:0/1434605471 shutdown_connections 2024-01-27T14:32:29.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.176+0000 7fefa682b640 1 -- 172.21.15.46:0/1434605471 wait complete. 2024-01-27T14:32:29.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.177+0000 7fefa682b640 1 Processor -- start 2024-01-27T14:32:29.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.177+0000 7fefa682b640 1 -- start start 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 0x7fefa015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa0153ac0 0x7fefa0159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa015b570 con 0x7fefa00c9910 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa015acd0 con 0x7fefa00cf7c0 2024-01-27T14:32:29.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fefa682b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa01efc50 con 0x7fefa0153ac0 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.178+0000 7fef9ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 0x7fefa015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.179+0000 7fefa4dc8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa0153ac0 0x7fefa0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.179+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56486/0 (socket says 172.21.15.46:56486) 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.179+0000 7fef9f7fe640 1 -- 172.21.15.46:0/1297252928 learned_addr learned my addr 172.21.15.46:0/1297252928 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:29.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.179+0000 7fef9ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 0x7fefa015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52914/0 (socket says 172.21.15.46:52914) 2024-01-27T14:32:29.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.182+0000 7fef9f7fe640 1 -- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa0153ac0 msgr2=0x7fefa0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.182+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa0153ac0 0x7fefa0159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.182+0000 7fef9f7fe640 1 -- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 msgr2=0x7fefa015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.182+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 0x7fefa015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.182+0000 7fef9f7fe640 1 -- 172.21.15.46:0/1297252928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009a70 con 0x7fefa00cf7c0 2024-01-27T14:32:29.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.185+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef9000e980 tx=0x7fef9000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:29.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.190+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90009670 con 0x7fefa00cf7c0 2024-01-27T14:32:29.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.190+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9000ca00 con 0x7fefa00cf7c0 2024-01-27T14:32:29.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.190+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa01eff30 con 0x7fefa00cf7c0 2024-01-27T14:32:29.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.190+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000cd90 con 0x7fefa00cf7c0 2024-01-27T14:32:29.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.190+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa015b200 con 0x7fefa00cf7c0 2024-01-27T14:32:29.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.191+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa015b720 con 0x7fefa00cf7c0 2024-01-27T14:32:29.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.429+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fef90013470 con 0x7fefa00cf7c0 2024-01-27T14:32:29.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.429+0000 7fef9cff9640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 0x7fef8c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.429+0000 7fef9ffff640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 0x7fef8c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.430+0000 7fef9ffff640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 0x7fef8c06d410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef94007fd0 tx=0x7fef94007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:29.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.433+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fef90058bb0 con 0x7fefa00cf7c0 2024-01-27T14:32:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.444+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fef90054ef0 con 0x7fefa00cf7c0 2024-01-27T14:32:29.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.651+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefa00c45b0 con 0x7fef8c06af50 2024-01-27T14:32:29.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.659+0000 7fef9cff9640 1 -- 172.21.15.46:0/1297252928 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345291 (secure 0 0 0) 0x7fef940013c0 con 0x7fef8c06af50 2024-01-27T14:32:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:29.661 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 msgr2=0x7fef8c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 0x7fef8c06d410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef94007fd0 tx=0x7fef94007e80 comp rx=0 tx=0).stop 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 msgr2=0x7fefa01f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef9000e980 tx=0x7fef9000ee40 comp rx=0 tx=0).stop 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 shutdown_connections 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fef8c06af50 0x7fef8c06d410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefa00cf7c0 0x7fefa01f05a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fefa0153ac0 0x7fefa0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 --2- 172.21.15.46:0/1297252928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa00c9910 0x7fefa015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.662+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 >> 172.21.15.46:0/1297252928 conn(0x7fefa006cca0 msgr2=0x7fefa0151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.663+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 shutdown_connections 2024-01-27T14:32:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.663+0000 7fefa682b640 1 -- 172.21.15.46:0/1297252928 wait complete. 2024-01-27T14:32:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-01-27T14:32:29.009845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595097,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232288,"kb_used_data":3648,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742432,"statfs":{"total":773094113280,"available":772856250368,"internally_reserved":0,"allocated":3735552,"data_stored":2192260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.741153"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238588+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:32:21.238588+0000","last_peered":"2024-01-27T14:32:21.238588+0000","last_clean":"2024-01-27T14:32:21.238588+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:32:21.238588+0000","last_undegraded":"2024-01-27T14:32:21.238588+0000","last_fullsized":"2024-01-27T14:32:21.238588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651376+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:32:21.651376+0000","last_peered":"2024-01-27T14:32:21.651376+0000","last_clean":"2024-01-27T14:32:21.651376+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:32:21.651376+0000","last_undegraded":"2024-01-27T14:32:21.651376+0000","last_fullsized":"2024-01-27T14:32:21.651376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292974+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:32:21.292974+0000","last_peered":"2024-01-27T14:32:21.292974+0000","last_clean":"2024-01-27T14:32:21.292974+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:32:21.292974+0000","last_undegraded":"2024-01-27T14:32:21.292974+0000","last_fullsized":"2024-01-27T14:32:21.292974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651466+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:32:21.651466+0000","last_peered":"2024-01-27T14:32:21.651466+0000","last_clean":"2024-01-27T14:32:21.651466+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:32:21.651466+0000","last_undegraded":"2024-01-27T14:32:21.651466+0000","last_fullsized":"2024-01-27T14:32:21.651466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651384+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:32:21.651384+0000","last_peered":"2024-01-27T14:32:21.651384+0000","last_clean":"2024-01-27T14:32:21.651384+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:32:21.651384+0000","last_undegraded":"2024-01-27T14:32:21.651384+0000","last_fullsized":"2024-01-27T14:32:21.651384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294582+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:32:21.294582+0000","last_peered":"2024-01-27T14:32:21.294582+0000","last_clean":"2024-01-27T14:32:21.294582+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:32:21.294582+0000","last_undegraded":"2024-01-27T14:32:21.294582+0000","last_fullsized":"2024-01-27T14:32:21.294582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652816+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:32:21.652816+0000","last_peered":"2024-01-27T14:32:21.652816+0000","last_clean":"2024-01-27T14:32:21.652816+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:32:21.652816+0000","last_undegraded":"2024-01-27T14:32:21.652816+0000","last_fullsized":"2024-01-27T14:32:21.652816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241636+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:32:21.241636+0000","last_peered":"2024-01-27T14:32:21.241636+0000","last_clean":"2024-01-27T14:32:21.241636+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:32:21.241636+0000","last_undegraded":"2024-01-27T14:32:21.241636+0000","last_fullsized":"2024-01-27T14:32:21.241636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294900+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:32:21.294900+0000","last_peered":"2024-01-27T14:32:21.294900+0000","last_clean":"2024-01-27T14:32:21.294900+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:32:21.294900+0000","last_undegraded":"2024-01-27T14:32:21.294900+0000","last_fullsized":"2024-01-27T14:32:21.294900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652463+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:32:21.652463+0000","last_peered":"2024-01-27T14:32:21.652463+0000","last_clean":"2024-01-27T14:32:21.652463+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:32:21.652463+0000","last_undegraded":"2024-01-27T14:32:21.652463+0000","last_fullsized":"2024-01-27T14:32:21.652463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652524+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:32:21.652524+0000","last_peered":"2024-01-27T14:32:21.652524+0000","last_clean":"2024-01-27T14:32:21.652524+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:32:21.652524+0000","last_undegraded":"2024-01-27T14:32:21.652524+0000","last_fullsized":"2024-01-27T14:32:21.652524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294671+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:32:21.294671+0000","last_peered":"2024-01-27T14:32:21.294671+0000","last_clean":"2024-01-27T14:32:21.294671+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:32:21.294671+0000","last_undegraded":"2024-01-27T14:32:21.294671+0000","last_fullsized":"2024-01-27T14:32:21.294671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651544+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:32:21.651544+0000","last_peered":"2024-01-27T14:32:21.651544+0000","last_clean":"2024-01-27T14:32:21.651544+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:32:21.651544+0000","last_undegraded":"2024-01-27T14:32:21.651544+0000","last_fullsized":"2024-01-27T14:32:21.651544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652390+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:32:21.652390+0000","last_peered":"2024-01-27T14:32:21.652390+0000","last_clean":"2024-01-27T14:32:21.652390+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:32:21.652390+0000","last_undegraded":"2024-01-27T14:32:21.652390+0000","last_fullsized":"2024-01-27T14:32:21.652390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651027+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:32:21.651027+0000","last_peered":"2024-01-27T14:32:21.651027+0000","last_clean":"2024-01-27T14:32:21.651027+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:32:21.651027+0000","last_undegraded":"2024-01-27T14:32:21.651027+0000","last_fullsized":"2024-01-27T14:32:21.651027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293539+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:32:21.293539+0000","last_peered":"2024-01-27T14:32:21.293539+0000","last_clean":"2024-01-27T14:32:21.293539+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:32:21.293539+0000","last_undegraded":"2024-01-27T14:32:21.293539+0000","last_fullsized":"2024-01-27T14:32:21.293539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295106+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:32:21.295106+0000","last_peered":"2024-01-27T14:32:21.295106+0000","last_clean":"2024-01-27T14:32:21.295106+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:32:21.295106+0000","last_undegraded":"2024-01-27T14:32:21.295106+0000","last_fullsized":"2024-01-27T14:32:21.295106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651904+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:32:21.651904+0000","last_peered":"2024-01-27T14:32:21.651904+0000","last_clean":"2024-01-27T14:32:21.651904+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:32:21.651904+0000","last_undegraded":"2024-01-27T14:32:21.651904+0000","last_fullsized":"2024-01-27T14:32:21.651904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237570+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:32:21.237570+0000","last_peered":"2024-01-27T14:32:21.237570+0000","last_clean":"2024-01-27T14:32:21.237570+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:32:21.237570+0000","last_undegraded":"2024-01-27T14:32:21.237570+0000","last_fullsized":"2024-01-27T14:32:21.237570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.876142+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:32:25.876142+0000","last_peered":"2024-01-27T14:32:25.876142+0000","last_clean":"2024-01-27T14:32:25.876142+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:32:25.876142+0000","last_undegraded":"2024-01-27T14:32:25.876142+0000","last_fullsized":"2024-01-27T14:32:25.876142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294096+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:32:21.294096+0000","last_peered":"2024-01-27T14:32:21.294096+0000","last_clean":"2024-01-27T14:32:21.294096+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:32:21.294096+0000","last_undegraded":"2024-01-27T14:32:21.294096+0000","last_fullsized":"2024-01-27T14:32:21.294096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651865+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:32:21.651865+0000","last_peered":"2024-01-27T14:32:21.651865+0000","last_clean":"2024-01-27T14:32:21.651865+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:32:21.651865+0000","last_undegraded":"2024-01-27T14:32:21.651865+0000","last_fullsized":"2024-01-27T14:32:21.651865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651467+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:32:21.651467+0000","last_peered":"2024-01-27T14:32:21.651467+0000","last_clean":"2024-01-27T14:32:21.651467+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:32:21.651467+0000","last_undegraded":"2024-01-27T14:32:21.651467+0000","last_fullsized":"2024-01-27T14:32:21.651467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295394+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:32:21.295394+0000","last_peered":"2024-01-27T14:32:21.295394+0000","last_clean":"2024-01-27T14:32:21.295394+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:32:21.295394+0000","last_undegraded":"2024-01-27T14:32:21.295394+0000","last_fullsized":"2024-01-27T14:32:21.295394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238196+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:32:21.238196+0000","last_peered":"2024-01-27T14:32:21.238196+0000","last_clean":"2024-01-27T14:32:21.238196+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:32:21.238196+0000","last_undegraded":"2024-01-27T14:32:21.238196+0000","last_fullsized":"2024-01-27T14:32:21.238196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652266+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:32:21.652266+0000","last_peered":"2024-01-27T14:32:21.652266+0000","last_clean":"2024-01-27T14:32:21.652266+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:32:21.652266+0000","last_undegraded":"2024-01-27T14:32:21.652266+0000","last_fullsized":"2024-01-27T14:32:21.652266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294635+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:32:21.294635+0000","last_peered":"2024-01-27T14:32:21.294635+0000","last_clean":"2024-01-27T14:32:21.294635+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:32:21.294635+0000","last_undegraded":"2024-01-27T14:32:21.294635+0000","last_fullsized":"2024-01-27T14:32:21.294635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238451+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:32:21.238451+0000","last_peered":"2024-01-27T14:32:21.238451+0000","last_clean":"2024-01-27T14:32:21.238451+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:32:21.238451+0000","last_undegraded":"2024-01-27T14:32:21.238451+0000","last_fullsized":"2024-01-27T14:32:21.238451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238393+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:32:21.238393+0000","last_peered":"2024-01-27T14:32:21.238393+0000","last_clean":"2024-01-27T14:32:21.238393+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:32:21.238393+0000","last_undegraded":"2024-01-27T14:32:21.238393+0000","last_fullsized":"2024-01-27T14:32:21.238393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237454+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:32:21.237454+0000","last_peered":"2024-01-27T14:32:21.237454+0000","last_clean":"2024-01-27T14:32:21.237454+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:32:21.237454+0000","last_undegraded":"2024-01-27T14:32:21.237454+0000","last_fullsized":"2024-01-27T14:32:21.237454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295251+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:32:21.295251+0000","last_peered":"2024-01-27T14:32:21.295251+0000","last_clean":"2024-01-27T14:32:21.295251+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:32:21.295251+0000","last_undegraded":"2024-01-27T14:32:21.295251+0000","last_fullsized":"2024-01-27T14:32:21.295251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651733+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:32:21.651733+0000","last_peered":"2024-01-27T14:32:21.651733+0000","last_clean":"2024-01-27T14:32:21.651733+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:32:21.651733+0000","last_undegraded":"2024-01-27T14:32:21.651733+0000","last_fullsized":"2024-01-27T14:32:21.651733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294883+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:32:21.294883+0000","last_peered":"2024-01-27T14:32:21.294883+0000","last_clean":"2024-01-27T14:32:21.294883+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:32:21.294883+0000","last_undegraded":"2024-01-27T14:32:21.294883+0000","last_fullsized":"2024-01-27T14:32:21.294883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295239+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:32:21.295239+0000","last_peered":"2024-01-27T14:32:21.295239+0000","last_clean":"2024-01-27T14:32:21.295239+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:32:21.295239+0000","last_undegraded":"2024-01-27T14:32:21.295239+0000","last_fullsized":"2024-01-27T14:32:21.295239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651065+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:32:21.651065+0000","last_peered":"2024-01-27T14:32:21.651065+0000","last_clean":"2024-01-27T14:32:21.651065+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:32:21.651065+0000","last_undegraded":"2024-01-27T14:32:21.651065+0000","last_fullsized":"2024-01-27T14:32:21.651065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294731+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:32:21.294731+0000","last_peered":"2024-01-27T14:32:21.294731+0000","last_clean":"2024-01-27T14:32:21.294731+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:32:21.294731+0000","last_undegraded":"2024-01-27T14:32:21.294731+0000","last_fullsized":"2024-01-27T14:32:21.294731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652309+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:32:21.652309+0000","last_peered":"2024-01-27T14:32:21.652309+0000","last_clean":"2024-01-27T14:32:21.652309+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:32:21.652309+0000","last_undegraded":"2024-01-27T14:32:21.652309+0000","last_fullsized":"2024-01-27T14:32:21.652309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652180+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:32:21.652180+0000","last_peered":"2024-01-27T14:32:21.652180+0000","last_clean":"2024-01-27T14:32:21.652180+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:32:21.652180+0000","last_undegraded":"2024-01-27T14:32:21.652180+0000","last_fullsized":"2024-01-27T14:32:21.652180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654208+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:32:21.654208+0000","last_peered":"2024-01-27T14:32:21.654208+0000","last_clean":"2024-01-27T14:32:21.654208+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:32:21.654208+0000","last_undegraded":"2024-01-27T14:32:21.654208+0000","last_fullsized":"2024-01-27T14:32:21.654208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650497+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:32:21.650497+0000","last_peered":"2024-01-27T14:32:21.650497+0000","last_clean":"2024-01-27T14:32:21.650497+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:32:21.650497+0000","last_undegraded":"2024-01-27T14:32:21.650497+0000","last_fullsized":"2024-01-27T14:32:21.650497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293110+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:32:21.293110+0000","last_peered":"2024-01-27T14:32:21.293110+0000","last_clean":"2024-01-27T14:32:21.293110+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:32:21.293110+0000","last_undegraded":"2024-01-27T14:32:21.293110+0000","last_fullsized":"2024-01-27T14:32:21.293110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295213+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:32:21.295213+0000","last_peered":"2024-01-27T14:32:21.295213+0000","last_clean":"2024-01-27T14:32:21.295213+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:32:21.295213+0000","last_undegraded":"2024-01-27T14:32:21.295213+0000","last_fullsized":"2024-01-27T14:32:21.295213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294709+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:32:21.294709+0000","last_peered":"2024-01-27T14:32:21.294709+0000","last_clean":"2024-01-27T14:32:21.294709+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:32:21.294709+0000","last_undegraded":"2024-01-27T14:32:21.294709+0000","last_fullsized":"2024-01-27T14:32:21.294709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651991+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:32:21.651991+0000","last_peered":"2024-01-27T14:32:21.651991+0000","last_clean":"2024-01-27T14:32:21.651991+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:32:21.651991+0000","last_undegraded":"2024-01-27T14:32:21.651991+0000","last_fullsized":"2024-01-27T14:32:21.651991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651175+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:32:21.651175+0000","last_peered":"2024-01-27T14:32:21.651175+0000","last_clean":"2024-01-27T14:32:21.651175+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:32:21.651175+0000","last_undegraded":"2024-01-27T14:32:21.651175+0000","last_fullsized":"2024-01-27T14:32:21.651175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237816+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:32:21.237816+0000","last_peered":"2024-01-27T14:32:21.237816+0000","last_clean":"2024-01-27T14:32:21.237816+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:32:21.237816+0000","last_undegraded":"2024-01-27T14:32:21.237816+0000","last_fullsized":"2024-01-27T14:32:21.237816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652451+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:32:21.652451+0000","last_peered":"2024-01-27T14:32:21.652451+0000","last_clean":"2024-01-27T14:32:21.652451+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:32:21.652451+0000","last_undegraded":"2024-01-27T14:32:21.652451+0000","last_fullsized":"2024-01-27T14:32:21.652451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241460+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:32:21.241460+0000","last_peered":"2024-01-27T14:32:21.241460+0000","last_clean":"2024-01-27T14:32:21.241460+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:32:21.241460+0000","last_undegraded":"2024-01-27T14:32:21.241460+0000","last_fullsized":"2024-01-27T14:32:21.241460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651549+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:32:21.651549+0000","last_peered":"2024-01-27T14:32:21.651549+0000","last_clean":"2024-01-27T14:32:21.651549+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:32:21.651549+0000","last_undegraded":"2024-01-27T14:32:21.651549+0000","last_fullsized":"2024-01-27T14:32:21.651549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651447+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:32:21.651447+0000","last_peered":"2024-01-27T14:32:21.651447+0000","last_clean":"2024-01-27T14:32:21.651447+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:32:21.651447+0000","last_undegraded":"2024-01-27T14:32:21.651447+0000","last_fullsized":"2024-01-27T14:32:21.651447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295338+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:32:21.295338+0000","last_peered":"2024-01-27T14:32:21.295338+0000","last_clean":"2024-01-27T14:32:21.295338+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:32:21.295338+0000","last_undegraded":"2024-01-27T14:32:21.295338+0000","last_fullsized":"2024-01-27T14:32:21.295338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294745+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:32:21.294745+0000","last_peered":"2024-01-27T14:32:21.294745+0000","last_clean":"2024-01-27T14:32:21.294745+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:32:21.294745+0000","last_undegraded":"2024-01-27T14:32:21.294745+0000","last_fullsized":"2024-01-27T14:32:21.294745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652358+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:32:21.652358+0000","last_peered":"2024-01-27T14:32:21.652358+0000","last_clean":"2024-01-27T14:32:21.652358+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:32:21.652358+0000","last_undegraded":"2024-01-27T14:32:21.652358+0000","last_fullsized":"2024-01-27T14:32:21.652358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651226+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:32:21.651226+0000","last_peered":"2024-01-27T14:32:21.651226+0000","last_clean":"2024-01-27T14:32:21.651226+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:32:21.651226+0000","last_undegraded":"2024-01-27T14:32:21.651226+0000","last_fullsized":"2024-01-27T14:32:21.651226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650897+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:32:21.650897+0000","last_peered":"2024-01-27T14:32:21.650897+0000","last_clean":"2024-01-27T14:32:21.650897+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:32:21.650897+0000","last_undegraded":"2024-01-27T14:32:21.650897+0000","last_fullsized":"2024-01-27T14:32:21.650897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652032+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:32:21.652032+0000","last_peered":"2024-01-27T14:32:21.652032+0000","last_clean":"2024-01-27T14:32:21.652032+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:32:21.652032+0000","last_undegraded":"2024-01-27T14:32:21.652032+0000","last_fullsized":"2024-01-27T14:32:21.652032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238292+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:32:21.238292+0000","last_peered":"2024-01-27T14:32:21.238292+0000","last_clean":"2024-01-27T14:32:21.238292+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:32:21.238292+0000","last_undegraded":"2024-01-27T14:32:21.238292+0000","last_fullsized":"2024-01-27T14:32:21.238292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651571+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:32:21.651571+0000","last_peered":"2024-01-27T14:32:21.651571+0000","last_clean":"2024-01-27T14:32:21.651571+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:32:21.651571+0000","last_undegraded":"2024-01-27T14:32:21.651571+0000","last_fullsized":"2024-01-27T14:32:21.651571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295584+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:32:21.295584+0000","last_peered":"2024-01-27T14:32:21.295584+0000","last_clean":"2024-01-27T14:32:21.295584+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:32:21.295584+0000","last_undegraded":"2024-01-27T14:32:21.295584+0000","last_fullsized":"2024-01-27T14:32:21.295584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652135+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:32:21.652135+0000","last_peered":"2024-01-27T14:32:21.652135+0000","last_clean":"2024-01-27T14:32:21.652135+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:32:21.652135+0000","last_undegraded":"2024-01-27T14:32:21.652135+0000","last_fullsized":"2024-01-27T14:32:21.652135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241389+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:32:21.241389+0000","last_peered":"2024-01-27T14:32:21.241389+0000","last_clean":"2024-01-27T14:32:21.241389+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:32:21.241389+0000","last_undegraded":"2024-01-27T14:32:21.241389+0000","last_fullsized":"2024-01-27T14:32:21.241389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651770+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:32:21.651770+0000","last_peered":"2024-01-27T14:32:21.651770+0000","last_clean":"2024-01-27T14:32:21.651770+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:32:21.651770+0000","last_undegraded":"2024-01-27T14:32:21.651770+0000","last_fullsized":"2024-01-27T14:32:21.651770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.873567+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:32:25.873567+0000","last_peered":"2024-01-27T14:32:25.873567+0000","last_clean":"2024-01-27T14:32:25.873567+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:32:25.873567+0000","last_undegraded":"2024-01-27T14:32:25.873567+0000","last_fullsized":"2024-01-27T14:32:25.873567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651327+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:32:21.651327+0000","last_peered":"2024-01-27T14:32:21.651327+0000","last_clean":"2024-01-27T14:32:21.651327+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:32:21.651327+0000","last_undegraded":"2024-01-27T14:32:21.651327+0000","last_fullsized":"2024-01-27T14:32:21.651327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241363+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:32:21.241363+0000","last_peered":"2024-01-27T14:32:21.241363+0000","last_clean":"2024-01-27T14:32:21.241363+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:32:21.241363+0000","last_undegraded":"2024-01-27T14:32:21.241363+0000","last_fullsized":"2024-01-27T14:32:21.241363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651913+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:32:21.651913+0000","last_peered":"2024-01-27T14:32:21.651913+0000","last_clean":"2024-01-27T14:32:21.651913+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:32:21.651913+0000","last_undegraded":"2024-01-27T14:32:21.651913+0000","last_fullsized":"2024-01-27T14:32:21.651913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651305+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:32:21.651305+0000","last_peered":"2024-01-27T14:32:21.651305+0000","last_clean":"2024-01-27T14:32:21.651305+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:32:21.651305+0000","last_undegraded":"2024-01-27T14:32:21.651305+0000","last_fullsized":"2024-01-27T14:32:21.651305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652240+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:32:21.652240+0000","last_peered":"2024-01-27T14:32:21.652240+0000","last_clean":"2024-01-27T14:32:21.652240+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:32:21.652240+0000","last_undegraded":"2024-01-27T14:32:21.652240+0000","last_fullsized":"2024-01-27T14:32:21.652240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652092+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:32:21.652092+0000","last_peered":"2024-01-27T14:32:21.652092+0000","last_clean":"2024-01-27T14:32:21.652092+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:32:21.652092+0000","last_undegraded":"2024-01-27T14:32:21.652092+0000","last_fullsized":"2024-01-27T14:32:21.652092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294990+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:32:21.294990+0000","last_peered":"2024-01-27T14:32:21.294990+0000","last_clean":"2024-01-27T14:32:21.294990+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:32:21.294990+0000","last_undegraded":"2024-01-27T14:32:21.294990+0000","last_fullsized":"2024-01-27T14:32:21.294990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294975+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:32:21.294975+0000","last_peered":"2024-01-27T14:32:21.294975+0000","last_clean":"2024-01-27T14:32:21.294975+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.294975+0000","last_undegraded":"2024-01-27T14:32:21.294975+0000","last_fullsized":"2024-01-27T14:32:21.294975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294068+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:32:21.294068+0000","last_peered":"2024-01-27T14:32:21.294068+0000","last_clean":"2024-01-27T14:32:21.294068+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:32:21.294068+0000","last_undegraded":"2024-01-27T14:32:21.294068+0000","last_fullsized":"2024-01-27T14:32:21.294068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.655214+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:32:21.655214+0000","last_peered":"2024-01-27T14:32:21.655214+0000","last_clean":"2024-01-27T14:32:21.655214+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:32:21.655214+0000","last_undegraded":"2024-01-27T14:32:21.655214+0000","last_fullsized":"2024-01-27T14:32:21.655214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652753+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:32:21.652753+0000","last_peered":"2024-01-27T14:32:21.652753+0000","last_clean":"2024-01-27T14:32:21.652753+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:32:21.652753+0000","last_undegraded":"2024-01-27T14:32:21.652753+0000","last_fullsized":"2024-01-27T14:32:21.652753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295088+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:32:21.295088+0000","last_peered":"2024-01-27T14:32:21.295088+0000","last_clean":"2024-01-27T14:32:21.295088+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:32:21.295088+0000","last_undegraded":"2024-01-27T14:32:21.295088+0000","last_fullsized":"2024-01-27T14:32:21.295088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237928+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:32:21.237928+0000","last_peered":"2024-01-27T14:32:21.237928+0000","last_clean":"2024-01-27T14:32:21.237928+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:32:21.237928+0000","last_undegraded":"2024-01-27T14:32:21.237928+0000","last_fullsized":"2024-01-27T14:32:21.237928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651594+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:32:21.651594+0000","last_peered":"2024-01-27T14:32:21.651594+0000","last_clean":"2024-01-27T14:32:21.651594+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:32:21.651594+0000","last_undegraded":"2024-01-27T14:32:21.651594+0000","last_fullsized":"2024-01-27T14:32:21.651594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293773+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:32:21.293773+0000","last_peered":"2024-01-27T14:32:21.293773+0000","last_clean":"2024-01-27T14:32:21.293773+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:32:21.293773+0000","last_undegraded":"2024-01-27T14:32:21.293773+0000","last_fullsized":"2024-01-27T14:32:21.293773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294920+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:32:21.294920+0000","last_peered":"2024-01-27T14:32:21.294920+0000","last_clean":"2024-01-27T14:32:21.294920+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:32:21.294920+0000","last_undegraded":"2024-01-27T14:32:21.294920+0000","last_fullsized":"2024-01-27T14:32:21.294920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651487+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:32:21.651487+0000","last_peered":"2024-01-27T14:32:21.651487+0000","last_clean":"2024-01-27T14:32:21.651487+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:32:21.651487+0000","last_undegraded":"2024-01-27T14:32:21.651487+0000","last_fullsized":"2024-01-27T14:32:21.651487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652785+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:32:21.652785+0000","last_peered":"2024-01-27T14:32:21.652785+0000","last_clean":"2024-01-27T14:32:21.652785+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:32:21.652785+0000","last_undegraded":"2024-01-27T14:32:21.652785+0000","last_fullsized":"2024-01-27T14:32:21.652785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292926+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:32:21.292926+0000","last_peered":"2024-01-27T14:32:21.292926+0000","last_clean":"2024-01-27T14:32:21.292926+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:32:21.292926+0000","last_undegraded":"2024-01-27T14:32:21.292926+0000","last_fullsized":"2024-01-27T14:32:21.292926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295496+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:32:21.295496+0000","last_peered":"2024-01-27T14:32:21.295496+0000","last_clean":"2024-01-27T14:32:21.295496+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:32:21.295496+0000","last_undegraded":"2024-01-27T14:32:21.295496+0000","last_fullsized":"2024-01-27T14:32:21.295496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.242122+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:32:21.242122+0000","last_peered":"2024-01-27T14:32:21.242122+0000","last_clean":"2024-01-27T14:32:21.242122+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:32:21.242122+0000","last_undegraded":"2024-01-27T14:32:21.242122+0000","last_fullsized":"2024-01-27T14:32:21.242122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237746+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:32:21.237746+0000","last_peered":"2024-01-27T14:32:21.237746+0000","last_clean":"2024-01-27T14:32:21.237746+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:32:21.237746+0000","last_undegraded":"2024-01-27T14:32:21.237746+0000","last_fullsized":"2024-01-27T14:32:21.237746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654246+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:32:21.654246+0000","last_peered":"2024-01-27T14:32:21.654246+0000","last_clean":"2024-01-27T14:32:21.654246+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:32:21.654246+0000","last_undegraded":"2024-01-27T14:32:21.654246+0000","last_fullsized":"2024-01-27T14:32:21.654246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237784+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:32:21.237784+0000","last_peered":"2024-01-27T14:32:21.237784+0000","last_clean":"2024-01-27T14:32:21.237784+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:32:21.237784+0000","last_undegraded":"2024-01-27T14:32:21.237784+0000","last_fullsized":"2024-01-27T14:32:21.237784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651897+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:32:21.651897+0000","last_peered":"2024-01-27T14:32:21.651897+0000","last_clean":"2024-01-27T14:32:21.651897+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:32:21.651897+0000","last_undegraded":"2024-01-27T14:32:21.651897+0000","last_fullsized":"2024-01-27T14:32:21.651897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652002+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:32:21.652002+0000","last_peered":"2024-01-27T14:32:21.652002+0000","last_clean":"2024-01-27T14:32:21.652002+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:32:21.652002+0000","last_undegraded":"2024-01-27T14:32:21.652002+0000","last_fullsized":"2024-01-27T14:32:21.652002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650619+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:32:21.650619+0000","last_peered":"2024-01-27T14:32:21.650619+0000","last_clean":"2024-01-27T14:32:21.650619+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:32:21.650619+0000","last_undegraded":"2024-01-27T14:32:21.650619+0000","last_fullsized":"2024-01-27T14:32:21.650619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294713+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:32:21.294713+0000","last_peered":"2024-01-27T14:32:21.294713+0000","last_clean":"2024-01-27T14:32:21.294713+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:32:21.294713+0000","last_undegraded":"2024-01-27T14:32:21.294713+0000","last_fullsized":"2024-01-27T14:32:21.294713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652482+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:32:21.652482+0000","last_peered":"2024-01-27T14:32:21.652482+0000","last_clean":"2024-01-27T14:32:21.652482+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:32:21.652482+0000","last_undegraded":"2024-01-27T14:32:21.652482+0000","last_fullsized":"2024-01-27T14:32:21.652482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237832+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:32:21.237832+0000","last_peered":"2024-01-27T14:32:21.237832+0000","last_clean":"2024-01-27T14:32:21.237832+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:32:21.237832+0000","last_undegraded":"2024-01-27T14:32:21.237832+0000","last_fullsized":"2024-01-27T14:32:21.237832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237968+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:32:21.237968+0000","last_peered":"2024-01-27T14:32:21.237968+0000","last_clean":"2024-01-27T14:32:21.237968+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:32:21.237968+0000","last_undegraded":"2024-01-27T14:32:21.237968+0000","last_fullsized":"2024-01-27T14:32:21.237968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651079+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:32:21.651079+0000","last_peered":"2024-01-27T14:32:21.651079+0000","last_clean":"2024-01-27T14:32:21.651079+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:32:21.651079+0000","last_undegraded":"2024-01-27T14:32:21.651079+0000","last_fullsized":"2024-01-27T14:32:21.651079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241561+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:32:21.241561+0000","last_peered":"2024-01-27T14:32:21.241561+0000","last_clean":"2024-01-27T14:32:21.241561+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:32:21.241561+0000","last_undegraded":"2024-01-27T14:32:21.241561+0000","last_fullsized":"2024-01-27T14:32:21.241561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293607+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:32:21.293607+0000","last_peered":"2024-01-27T14:32:21.293607+0000","last_clean":"2024-01-27T14:32:21.293607+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:32:21.293607+0000","last_undegraded":"2024-01-27T14:32:21.293607+0000","last_fullsized":"2024-01-27T14:32:21.293607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294584+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:32:21.294584+0000","last_peered":"2024-01-27T14:32:21.294584+0000","last_clean":"2024-01-27T14:32:21.294584+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:32:21.294584+0000","last_undegraded":"2024-01-27T14:32:21.294584+0000","last_fullsized":"2024-01-27T14:32:21.294584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293063+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:32:21.293063+0000","last_peered":"2024-01-27T14:32:21.293063+0000","last_clean":"2024-01-27T14:32:21.293063+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:32:21.293063+0000","last_undegraded":"2024-01-27T14:32:21.293063+0000","last_fullsized":"2024-01-27T14:32:21.293063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651459+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:32:21.651459+0000","last_peered":"2024-01-27T14:32:21.651459+0000","last_clean":"2024-01-27T14:32:21.651459+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:32:21.651459+0000","last_undegraded":"2024-01-27T14:32:21.651459+0000","last_fullsized":"2024-01-27T14:32:21.651459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650996+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:32:21.650996+0000","last_peered":"2024-01-27T14:32:21.650996+0000","last_clean":"2024-01-27T14:32:21.650996+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:32:21.650996+0000","last_undegraded":"2024-01-27T14:32:21.650996+0000","last_fullsized":"2024-01-27T14:32:21.650996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295167+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:32:21.295167+0000","last_peered":"2024-01-27T14:32:21.295167+0000","last_clean":"2024-01-27T14:32:21.295167+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:32:21.295167+0000","last_undegraded":"2024-01-27T14:32:21.295167+0000","last_fullsized":"2024-01-27T14:32:21.295167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295361+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:32:21.295361+0000","last_peered":"2024-01-27T14:32:21.295361+0000","last_clean":"2024-01-27T14:32:21.295361+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:32:21.295361+0000","last_undegraded":"2024-01-27T14:32:21.295361+0000","last_fullsized":"2024-01-27T14:32:21.295361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295399+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:32:21.295399+0000","last_peered":"2024-01-27T14:32:21.295399+0000","last_clean":"2024-01-27T14:32:21.295399+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:32:21.295399+0000","last_undegraded":"2024-01-27T14:32:21.295399+0000","last_fullsized":"2024-01-27T14:32:21.295399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651227+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:32:21.651227+0000","last_peered":"2024-01-27T14:32:21.651227+0000","last_clean":"2024-01-27T14:32:21.651227+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:32:21.651227+0000","last_undegraded":"2024-01-27T14:32:21.651227+0000","last_fullsized":"2024-01-27T14:32:21.651227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651809+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:32:21.651809+0000","last_peered":"2024-01-27T14:32:21.651809+0000","last_clean":"2024-01-27T14:32:21.651809+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:32:21.651809+0000","last_undegraded":"2024-01-27T14:32:21.651809+0000","last_fullsized":"2024-01-27T14:32:21.651809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650583+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:32:21.650583+0000","last_peered":"2024-01-27T14:32:21.650583+0000","last_clean":"2024-01-27T14:32:21.650583+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:32:21.650583+0000","last_undegraded":"2024-01-27T14:32:21.650583+0000","last_fullsized":"2024-01-27T14:32:21.650583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241509+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:32:21.241509+0000","last_peered":"2024-01-27T14:32:21.241509+0000","last_clean":"2024-01-27T14:32:21.241509+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.241509+0000","last_undegraded":"2024-01-27T14:32:21.241509+0000","last_fullsized":"2024-01-27T14:32:21.241509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237731+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:32:21.237731+0000","last_peered":"2024-01-27T14:32:21.237731+0000","last_clean":"2024-01-27T14:32:21.237731+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:32:21.237731+0000","last_undegraded":"2024-01-27T14:32:21.237731+0000","last_fullsized":"2024-01-27T14:32:21.237731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652272+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:32:21.652272+0000","last_peered":"2024-01-27T14:32:21.652272+0000","last_clean":"2024-01-27T14:32:21.652272+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:32:21.652272+0000","last_undegraded":"2024-01-27T14:32:21.652272+0000","last_fullsized":"2024-01-27T14:32:21.652272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651644+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:32:21.651644+0000","last_peered":"2024-01-27T14:32:21.651644+0000","last_clean":"2024-01-27T14:32:21.651644+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:32:21.651644+0000","last_undegraded":"2024-01-27T14:32:21.651644+0000","last_fullsized":"2024-01-27T14:32:21.651644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293934+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:32:21.293934+0000","last_peered":"2024-01-27T14:32:21.293934+0000","last_clean":"2024-01-27T14:32:21.293934+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:32:21.293934+0000","last_undegraded":"2024-01-27T14:32:21.293934+0000","last_fullsized":"2024-01-27T14:32:21.293934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652172+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:32:21.652172+0000","last_peered":"2024-01-27T14:32:21.652172+0000","last_clean":"2024-01-27T14:32:21.652172+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:32:21.652172+0000","last_undegraded":"2024-01-27T14:32:21.652172+0000","last_fullsized":"2024-01-27T14:32:21.652172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651716+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:32:21.651716+0000","last_peered":"2024-01-27T14:32:21.651716+0000","last_clean":"2024-01-27T14:32:21.651716+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:32:21.651716+0000","last_undegraded":"2024-01-27T14:32:21.651716+0000","last_fullsized":"2024-01-27T14:32:21.651716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650693+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:32:21.650693+0000","last_peered":"2024-01-27T14:32:21.650693+0000","last_clean":"2024-01-27T14:32:21.650693+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:32:21.650693+0000","last_undegraded":"2024-01-27T14:32:21.650693+0000","last_fullsized":"2024-01-27T14:32:21.650693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294879+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:32:21.294879+0000","last_peered":"2024-01-27T14:32:21.294879+0000","last_clean":"2024-01-27T14:32:21.294879+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:32:21.294879+0000","last_undegraded":"2024-01-27T14:32:21.294879+0000","last_fullsized":"2024-01-27T14:32:21.294879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295073+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:32:21.295073+0000","last_peered":"2024-01-27T14:32:21.295073+0000","last_clean":"2024-01-27T14:32:21.295073+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:32:21.295073+0000","last_undegraded":"2024-01-27T14:32:21.295073+0000","last_fullsized":"2024-01-27T14:32:21.295073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652186+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:32:21.652186+0000","last_peered":"2024-01-27T14:32:21.652186+0000","last_clean":"2024-01-27T14:32:21.652186+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:32:21.652186+0000","last_undegraded":"2024-01-27T14:32:21.652186+0000","last_fullsized":"2024-01-27T14:32:21.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652698+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:32:21.652698+0000","last_peered":"2024-01-27T14:32:21.652698+0000","last_clean":"2024-01-27T14:32:21.652698+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:32:21.652698+0000","last_undegraded":"2024-01-27T14:32:21.652698+0000","last_fullsized":"2024-01-27T14:32:21.652698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652572+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:32:21.652572+0000","last_peered":"2024-01-27T14:32:21.652572+0000","last_clean":"2024-01-27T14:32:21.652572+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:32:21.652572+0000","last_undegraded":"2024-01-27T14:32:21.652572+0000","last_fullsized":"2024-01-27T14:32:21.652572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241969+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:32:21.241969+0000","last_peered":"2024-01-27T14:32:21.241969+0000","last_clean":"2024-01-27T14:32:21.241969+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:32:21.241969+0000","last_undegraded":"2024-01-27T14:32:21.241969+0000","last_fullsized":"2024-01-27T14:32:21.241969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650428+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:32:21.650428+0000","last_peered":"2024-01-27T14:32:21.650428+0000","last_clean":"2024-01-27T14:32:21.650428+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:32:21.650428+0000","last_undegraded":"2024-01-27T14:32:21.650428+0000","last_fullsized":"2024-01-27T14:32:21.650428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651824+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:32:21.651824+0000","last_peered":"2024-01-27T14:32:21.651824+0000","last_clean":"2024-01-27T14:32:21.651824+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:32:21.651824+0000","last_undegraded":"2024-01-27T14:32:21.651824+0000","last_fullsized":"2024-01-27T14:32:21.651824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294824+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:32:21.294824+0000","last_peered":"2024-01-27T14:32:21.294824+0000","last_clean":"2024-01-27T14:32:21.294824+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:32:21.294824+0000","last_undegraded":"2024-01-27T14:32:21.294824+0000","last_fullsized":"2024-01-27T14:32:21.294824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654122+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:32:21.654122+0000","last_peered":"2024-01-27T14:32:21.654122+0000","last_clean":"2024-01-27T14:32:21.654122+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:32:21.654122+0000","last_undegraded":"2024-01-27T14:32:21.654122+0000","last_fullsized":"2024-01-27T14:32:21.654122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294919+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:32:21.294919+0000","last_peered":"2024-01-27T14:32:21.294919+0000","last_clean":"2024-01-27T14:32:21.294919+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:32:21.294919+0000","last_undegraded":"2024-01-27T14:32:21.294919+0000","last_fullsized":"2024-01-27T14:32:21.294919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651126+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:32:21.651126+0000","last_peered":"2024-01-27T14:32:21.651126+0000","last_clean":"2024-01-27T14:32:21.651126+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:32:21.651126+0000","last_undegraded":"2024-01-27T14:32:21.651126+0000","last_fullsized":"2024-01-27T14:32:21.651126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651251+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:32:21.651251+0000","last_peered":"2024-01-27T14:32:21.651251+0000","last_clean":"2024-01-27T14:32:21.651251+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:32:21.651251+0000","last_undegraded":"2024-01-27T14:32:21.651251+0000","last_fullsized":"2024-01-27T14:32:21.651251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651939+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:32:21.651939+0000","last_peered":"2024-01-27T14:32:21.651939+0000","last_clean":"2024-01-27T14:32:21.651939+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:32:21.651939+0000","last_undegraded":"2024-01-27T14:32:21.651939+0000","last_fullsized":"2024-01-27T14:32:21.651939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4729,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":10684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":125229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":715565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":128946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":715543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":125161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":130402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:32:29.675 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-27T14:32:29.675 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-27T14:32:29.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-27T14:32:29.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-27T14:32:29.676 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-27T14:32:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.819+0000 7f779e8a6640 1 Processor -- start 2024-01-27T14:32:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.819+0000 7f779e8a6640 1 -- start start 2024-01-27T14:32:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.819+0000 7f779e8a6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f77980cc1d0 0x7f779815a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f779e8a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77980cc5b0 0x7f7798156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f779e8a6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779815a860 con 0x7f779806b0f0 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f779e8a6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980c8a60 con 0x7f77980cc1d0 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f779e8a6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980c8760 con 0x7f77980cc5b0 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f779ce43640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77980cc5b0 0x7f7798156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.820+0000 7f7797fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f77980cc1d0 0x7f779815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.821+0000 7f779ce43640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77980cc5b0 0x7f7798156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56500/0 (socket says 172.21.15.46:56500) 2024-01-27T14:32:29.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.821+0000 7f779ce43640 1 -- 172.21.15.46:0/4137455806 learned_addr learned my addr 172.21.15.46:0/4137455806 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:29.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.823+0000 7f779ce43640 1 -- 172.21.15.46:0/4137455806 >> v2:172.21.15.46:3300/0 conn(0x7f77980cc1d0 msgr2=0x7f779815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:29.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.823+0000 7f779ce43640 1 --2- 172.21.15.46:0/4137455806 >> v2:172.21.15.46:3300/0 conn(0x7f77980cc1d0 0x7f779815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.823+0000 7f779ce43640 1 -- 172.21.15.46:0/4137455806 >> v1:172.21.15.46:6789/0 conn(0x7f779806b0f0 legacy=0x7f77980c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.823+0000 7f779ce43640 1 -- 172.21.15.46:0/4137455806 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779806de90 con 0x7f77980cc5b0 2024-01-27T14:32:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.827+0000 7f779ce43640 1 --2- 172.21.15.46:0/4137455806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f7798156840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77980c9ea0 tx=0x7f779002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47de745f9bdbd26c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:29.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.831+0000 7f7796ffd640 1 -- 172.21.15.46:0/4137455806 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779002cbb0 con 0x7f77980cc5b0 2024-01-27T14:32:29.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.831+0000 7f7796ffd640 1 -- 172.21.15.46:0/4137455806 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779002cd10 con 0x7f77980cc5b0 2024-01-27T14:32:29.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.831+0000 7f7796ffd640 1 -- 172.21.15.46:0/4137455806 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790034610 con 0x7f77980cc5b0 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 -- 172.21.15.46:0/4137455806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 msgr2=0x7f7798156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 --2- 172.21.15.46:0/4137455806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f7798156840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77980c9ea0 tx=0x7f779002c010 comp rx=0 tx=0).stop 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 -- 172.21.15.46:0/4137455806 shutdown_connections 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 --2- 172.21.15.46:0/4137455806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f7798156840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 --2- 172.21.15.46:0/4137455806 >> v2:172.21.15.46:3300/0 conn(0x7f77980cc1d0 0x7f779815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 -- 172.21.15.46:0/4137455806 >> 172.21.15.46:0/4137455806 conn(0x7f779806fdf0 msgr2=0x7f77980701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 -- 172.21.15.46:0/4137455806 shutdown_connections 2024-01-27T14:32:29.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.832+0000 7f779e8a6640 1 -- 172.21.15.46:0/4137455806 wait complete. 2024-01-27T14:32:29.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.834+0000 7f779e8a6640 1 Processor -- start 2024-01-27T14:32:29.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.834+0000 7f779e8a6640 1 -- start start 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f779806b0f0 0x7f7798152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 0x7f77981ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c5c20 con 0x7f779806b0f0 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981eff20 con 0x7f77980cc5b0 2024-01-27T14:32:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.835+0000 7f779e8a6640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7798152c40 con 0x7f77980cc1d0 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f7797fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f779806b0f0 0x7f7798152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f77977fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 0x7f77981ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f779ce43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f779ce43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56510/0 (socket says 172.21.15.46:56510) 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f77977fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 0x7f77981ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47482/0 (socket says 172.21.15.46:47482) 2024-01-27T14:32:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.836+0000 7f779ce43640 1 -- 172.21.15.46:0/2203878853 learned_addr learned my addr 172.21.15.46:0/2203878853 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.839+0000 7f779ce43640 1 -- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 msgr2=0x7f77981ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.839+0000 7f779ce43640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 0x7f77981ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.839+0000 7f779ce43640 1 -- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f779806b0f0 msgr2=0x7f7798152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.839+0000 7f779ce43640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f779806b0f0 0x7f7798152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.839+0000 7f779ce43640 1 -- 172.21.15.46:0/2203878853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009b30 con 0x7f77980cc5b0 2024-01-27T14:32:29.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.841+0000 7f779ce43640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7790036040 tx=0x7f7790004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.845+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779003e450 con 0x7f77980cc5b0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.845+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779003e5b0 con 0x7f77980cc5b0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.845+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7798151230 con 0x7f77980cc5b0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.845+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779003e960 con 0x7f77980cc5b0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.845+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77981517f0 con 0x7f77980cc5b0 2024-01-27T14:32:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:29.846+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980742e0 con 0x7f77980cc5b0 2024-01-27T14:32:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.086+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f779003eac0 con 0x7f77980cc5b0 2024-01-27T14:32:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.086+0000 7f7794ff9640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 0x7f778406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.086+0000 7f7797fff640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 0x7f778406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.087+0000 7f7797fff640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 0x7f778406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7788009b40 tx=0x7f7788009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.088+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f779007b470 con 0x7f77980cc5b0 2024-01-27T14:32:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.100+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f77900777b0 con 0x7f77980cc5b0 2024-01-27T14:32:30.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.329+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f77980704b0 con 0x7f77980cc5b0 2024-01-27T14:32:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.467+0000 7f7794ff9640 1 -- 172.21.15.46:0/2203878853 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170771 (secure 0 0 0) 0x7f7790043020 con 0x7f77980cc5b0 2024-01-27T14:32:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 msgr2=0x7f778406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 0x7f778406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7788009b40 tx=0x7f7788009190 comp rx=0 tx=0).stop 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 msgr2=0x7f779815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7790036040 tx=0x7f7790004a40 comp rx=0 tx=0).stop 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 shutdown_connections 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f778406aed0 0x7f778406d390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77980cc5b0 0x7f779815c000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77980cc1d0 0x7f77981ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 --2- 172.21.15.46:0/2203878853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f779806b0f0 0x7f7798152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 >> 172.21.15.46:0/2203878853 conn(0x7f779806fdf0 msgr2=0x7f77980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 shutdown_connections 2024-01-27T14:32:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.471+0000 7f779e8a6640 1 -- 172.21.15.46:0/2203878853 wait complete. 2024-01-27T14:32:30.480 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":82124097},{"type":"v1","addr":"172.21.15.46:6801","nonce":82124097}]},"active_addr":"172.21.15.46:6801/82124097","active_change":"2024-01-27T14:31:18.636060+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4122054970}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3832792447}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":324311494}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":778996892}]}]} 2024-01-27T14:32:30.486 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-27T14:32:30.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-27T14:32:30.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.595+0000 7f1b53e9e640 1 Processor -- start 2024-01-27T14:32:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.595+0000 7f1b53e9e640 1 -- start start 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b4c1517f0 0x7f1b4c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b4c06dee0 0x7f1b4c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c06e8e0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c15b070 con 0x7f1b4c1517f0 2024-01-27T14:32:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.596+0000 7f1b53e9e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c15b350 con 0x7f1b4c070870 2024-01-27T14:32:30.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.633+0000 7f1b51439640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.634+0000 7f1b51439640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47498/0 (socket says 172.21.15.46:47498) 2024-01-27T14:32:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.634+0000 7f1b51439640 1 -- 172.21.15.46:0/4217001349 learned_addr learned my addr 172.21.15.46:0/4217001349 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:30.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.636+0000 7f1b51439640 1 -- 172.21.15.46:0/4217001349 >> v2:172.21.15.73:3300/0 conn(0x7f1b4c1517f0 msgr2=0x7f1b4c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.636+0000 7f1b51439640 1 --2- 172.21.15.46:0/4217001349 >> v2:172.21.15.73:3300/0 conn(0x7f1b4c1517f0 0x7f1b4c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.636+0000 7f1b51439640 1 -- 172.21.15.46:0/4217001349 >> v2:172.21.15.46:3300/0 conn(0x7f1b4c06dee0 msgr2=0x7f1b4c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.636+0000 7f1b51439640 1 --2- 172.21.15.46:0/4217001349 >> v2:172.21.15.46:3300/0 conn(0x7f1b4c06dee0 0x7f1b4c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.636+0000 7f1b51439640 1 -- 172.21.15.46:0/4217001349 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c15b630 con 0x7f1b4c070870 2024-01-27T14:32:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.638+0000 7f1b51439640 1 --2- 172.21.15.46:0/4217001349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0c8900 tx=0x7f1b3c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa1b8f13464d058 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.642+0000 7f1b50c38640 1 -- 172.21.15.46:0/4217001349 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c031870 con 0x7f1b4c070870 2024-01-27T14:32:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.642+0000 7f1b50c38640 1 -- 172.21.15.46:0/4217001349 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0319d0 con 0x7f1b4c070870 2024-01-27T14:32:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.642+0000 7f1b50c38640 1 -- 172.21.15.46:0/4217001349 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c031d60 con 0x7f1b4c070870 2024-01-27T14:32:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.642+0000 7f1b53e9e640 1 -- 172.21.15.46:0/4217001349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 msgr2=0x7f1b4c0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.642+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/4217001349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0c8900 tx=0x7f1b3c02b910 comp rx=0 tx=0).stop 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 -- 172.21.15.46:0/4217001349 shutdown_connections 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/4217001349 >> v2:172.21.15.46:3300/0 conn(0x7f1b4c06dee0 0x7f1b4c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/4217001349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c0c8930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/4217001349 >> v2:172.21.15.73:3300/0 conn(0x7f1b4c1517f0 0x7f1b4c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 -- 172.21.15.46:0/4217001349 >> 172.21.15.46:0/4217001349 conn(0x7f1b4c072750 msgr2=0x7f1b4c06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 -- 172.21.15.46:0/4217001349 shutdown_connections 2024-01-27T14:32:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.643+0000 7f1b53e9e640 1 -- 172.21.15.46:0/4217001349 wait complete. 2024-01-27T14:32:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.644+0000 7f1b53e9e640 1 Processor -- start 2024-01-27T14:32:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.644+0000 7f1b53e9e640 1 -- start start 2024-01-27T14:32:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b4c1517f0 0x7f1b4c1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c14d3a0 con 0x7f1b4c1517f0 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0c22d0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b53e9e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1f2650 con 0x7f1b4c070870 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b51c3a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b51439640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b51c3a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56524/0 (socket says 172.21.15.46:56524) 2024-01-27T14:32:30.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.645+0000 7f1b51c3a640 1 -- 172.21.15.46:0/1972140773 learned_addr learned my addr 172.21.15.46:0/1972140773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:30.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.648+0000 7f1b5243b640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b4c1517f0 0x7f1b4c1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.649+0000 7f1b51c3a640 1 -- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 msgr2=0x7f1b4c1f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:30.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.649+0000 7f1b51c3a640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c1f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.649+0000 7f1b51c3a640 1 -- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b4c1517f0 msgr2=0x7f1b4c1f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:30.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.649+0000 7f1b51c3a640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b4c1517f0 0x7f1b4c1f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:30.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.649+0000 7f1b51c3a640 1 -- 172.21.15.46:0/1972140773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0094d0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.652+0000 7f1b51c3a640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b4d0 tx=0x7f1b4800b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:30.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.655+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48010870 con 0x7f1b4c06dee0 2024-01-27T14:32:30.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.655+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b480109d0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.656+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c0c2dc0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.656+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48010d80 con 0x7f1b4c06dee0 2024-01-27T14:32:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.656+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c0c2800 con 0x7f1b4c06dee0 2024-01-27T14:32:30.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.656+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c066f20 con 0x7f1b4c06dee0 2024-01-27T14:32:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.904+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1b48023480 con 0x7f1b4c06dee0 2024-01-27T14:32:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.905+0000 7f1b427fc640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 0x7f1b3006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.905+0000 7f1b51439640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 0x7f1b3006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:30.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.905+0000 7f1b51439640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 0x7f1b3006d3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c036000 tx=0x7f1b3c03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.907+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1b480586c0 con 0x7f1b4c06dee0 2024-01-27T14:32:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:30.919+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1b48054a00 con 0x7f1b4c06dee0 2024-01-27T14:32:31.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.105+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4c06f390 con 0x7f1b4c06dee0 2024-01-27T14:32:31.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.185+0000 7f1b427fc640 1 -- 172.21.15.46:0/1972140773 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f1b4801e090 con 0x7f1b4c06dee0 2024-01-27T14:32:31.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:31.182 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 msgr2=0x7f1b3006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 0x7f1b3006d3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c036000 tx=0x7f1b3c03c040 comp rx=0 tx=0).stop 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 msgr2=0x7f1b4c1502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b4d0 tx=0x7f1b4800b990 comp rx=0 tx=0).stop 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 shutdown_connections 2024-01-27T14:32:31.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1b3006af20 0x7f1b3006d3e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b4c1517f0 0x7f1b4c1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b4c070870 0x7f1b4c1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 --2- 172.21.15.46:0/1972140773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b4c06dee0 0x7f1b4c1502c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 >> 172.21.15.46:0/1972140773 conn(0x7f1b4c072750 msgr2=0x7f1b4c155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 shutdown_connections 2024-01-27T14:32:31.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.187+0000 7f1b53e9e640 1 -- 172.21.15.46:0/1972140773 wait complete. 2024-01-27T14:32:31.196 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-27T14:32:31.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:31.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.301+0000 7f475bd6f640 1 Processor -- start 2024-01-27T14:32:31.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.301+0000 7f475bd6f640 1 -- start start 2024-01-27T14:32:31.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.302+0000 7f475bd6f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 0x7f4754162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:31.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.302+0000 7f475bd6f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754151c20 con 0x7f475406de00 2024-01-27T14:32:31.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.302+0000 7f475bd6f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754157670 con 0x7f4754151840 2024-01-27T14:32:31.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.302+0000 7f475bd6f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475415b8e0 con 0x7f475406e250 2024-01-27T14:32:31.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.303+0000 7f475930a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f475406de00 0x7f4754157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57296/0 (socket says 172.21.15.46:57296) 2024-01-27T14:32:31.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.303+0000 7f475930a640 1 -- 172.21.15.46:0/2755768671 learned_addr learned my addr 172.21.15.46:0/2755768671 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:31.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.303+0000 7f475a30c640 1 --2- 172.21.15.46:0/2755768671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 0x7f4754162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225830130 0 0) 0x7f4754151c20 con 0x7f475406de00 2024-01-27T14:32:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c003520 con 0x7f475406de00 2024-01-27T14:32:31.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f475a30c640 1 -- 172.21.15.46:0/2755768671 >> v1:172.21.15.73:6789/0 conn(0x7f4754151840 legacy=0x7f475406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078840763 0 0) 0x7f4754157670 con 0x7f4754151840 2024-01-27T14:32:31.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f475a30c640 1 -- 172.21.15.46:0/2755768671 >> v1:172.21.15.46:6789/0 conn(0x7f475406de00 legacy=0x7f4754157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.305+0000 7f475a30c640 1 -- 172.21.15.46:0/2755768671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475406e680 con 0x7f475406e250 2024-01-27T14:32:31.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.307+0000 7f475a30c640 1 --2- 172.21.15.46:0/2755768671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 0x7f4754162d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097d0 tx=0x7f474c02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b701ce54d3efb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:31.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.311+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c030880 con 0x7f475406e250 2024-01-27T14:32:31.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.311+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0309e0 con 0x7f475406e250 2024-01-27T14:32:31.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.311+0000 7f4758b09640 1 -- 172.21.15.46:0/2755768671 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c030d70 con 0x7f475406e250 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 -- 172.21.15.46:0/2755768671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 msgr2=0x7f4754162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2755768671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 0x7f4754162d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097d0 tx=0x7f474c02b9c0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 -- 172.21.15.46:0/2755768671 shutdown_connections 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2755768671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f475406e250 0x7f4754162d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 -- 172.21.15.46:0/2755768671 >> 172.21.15.46:0/2755768671 conn(0x7f475406fdf0 msgr2=0x7f47540701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 -- 172.21.15.46:0/2755768671 shutdown_connections 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.312+0000 7f475bd6f640 1 -- 172.21.15.46:0/2755768671 wait complete. 2024-01-27T14:32:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.313+0000 7f475bd6f640 1 Processor -- start 2024-01-27T14:32:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.313+0000 7f475bd6f640 1 -- start start 2024-01-27T14:32:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475406e250 0x7f47541f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4754151840 0x7f47541f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541ef470 con 0x7f475406de00 2024-01-27T14:32:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541ef730 con 0x7f475406e250 2024-01-27T14:32:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475bd6f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47541efa10 con 0x7f4754151840 2024-01-27T14:32:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f4759b0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475930a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475406e250 0x7f47541f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f475a30c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4754151840 0x7f47541f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f4759b0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52954/0 (socket says 172.21.15.46:52954) 2024-01-27T14:32:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.314+0000 7f4759b0b640 1 -- 172.21.15.46:0/2746884037 learned_addr learned my addr 172.21.15.46:0/2746884037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.318+0000 7f4759b0b640 1 -- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4754151840 msgr2=0x7f47541f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.318+0000 7f4759b0b640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4754151840 0x7f47541f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.318+0000 7f4759b0b640 1 -- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475406e250 msgr2=0x7f47541f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.318+0000 7f4759b0b640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475406e250 0x7f47541f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.318+0000 7f4759b0b640 1 -- 172.21.15.46:0/2746884037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009400 con 0x7f475406de00 2024-01-27T14:32:31.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.320+0000 7f4759b0b640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f474400c890 tx=0x7f474400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.324+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744003da0 con 0x7f475406de00 2024-01-27T14:32:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.324+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4744005070 con 0x7f475406de00 2024-01-27T14:32:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.324+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47541efcf0 con 0x7f475406de00 2024-01-27T14:32:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.324+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744005420 con 0x7f475406de00 2024-01-27T14:32:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.324+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541f26d0 con 0x7f475406de00 2024-01-27T14:32:31.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.325+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47540742e0 con 0x7f475406de00 2024-01-27T14:32:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.590+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4744005580 con 0x7f475406de00 2024-01-27T14:32:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.590+0000 7f47527fc640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 0x7f474006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.590+0000 7f475930a640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 0x7f474006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.591+0000 7f475930a640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 0x7f474006d3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f475415a850 tx=0x7f4748009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.607+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4744057fd0 con 0x7f475406de00 2024-01-27T14:32:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.608+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4744054310 con 0x7f475406de00 2024-01-27T14:32:31.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.818+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47541572f0 con 0x7f475406de00 2024-01-27T14:32:31.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.861+0000 7f47527fc640 1 -- 172.21.15.46:0/2746884037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f4744017070 con 0x7f475406de00 2024-01-27T14:32:31.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:31.859 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 msgr2=0x7f474006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 0x7f474006d3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f475415a850 tx=0x7f4748009040 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 msgr2=0x7f47540caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f474400c890 tx=0x7f474400cd50 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 shutdown_connections 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f474006af20 0x7f474006d3e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475406e250 0x7f47541f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4754151840 0x7f47541f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 --2- 172.21.15.46:0/2746884037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f475406de00 0x7f47540caa50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 >> 172.21.15.46:0/2746884037 conn(0x7f475406fdf0 msgr2=0x7f4754150450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 shutdown_connections 2024-01-27T14:32:31.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:31.864+0000 7f475bd6f640 1 -- 172.21.15.46:0/2746884037 wait complete. 2024-01-27T14:32:31.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-27T14:32:31.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-27T14:32:31.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-27T14:32:31.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-27T14:32:31.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-27T14:32:31.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-27T14:32:31.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-27T14:32:31.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-27T14:32:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.069+0000 7f1c965a9640 1 Processor -- start 2024-01-27T14:32:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.069+0000 7f1c965a9640 1 -- start start 2024-01-27T14:32:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.071+0000 7f1c965a9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c900c5ce0 0x7f1c901693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.071+0000 7f1c965a9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c900c2120 con 0x7f1c900b0c80 2024-01-27T14:32:32.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.071+0000 7f1c965a9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c90161510 con 0x7f1c900c5900 2024-01-27T14:32:32.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.072+0000 7f1c965a9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9006e140 con 0x7f1c900c5ce0 2024-01-27T14:32:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.072+0000 7f0e4ba8e640 1 Processor -- start 2024-01-27T14:32:32.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.073+0000 7f1c8ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1c900c5900 0x7f1c901619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:37100/0 (socket says 172.21.15.46:37100) 2024-01-27T14:32:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.073+0000 7f1c8ffff640 1 -- 172.21.15.46:0/2013797894 learned_addr learned my addr 172.21.15.46:0/2013797894 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.074+0000 7f1c94b46640 1 --2- 172.21.15.46:0/2013797894 >> v2:172.21.15.46:3300/0 conn(0x7f1c900c5ce0 0x7f1c901693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.073+0000 7f0e4ba8e640 1 -- start start 2024-01-27T14:32:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.075+0000 7f0e4ba8e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.075+0000 7f0e4ba8e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0e4406c820 0x7f0e440c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.075+0000 7f0e4ba8e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e441584d0 con 0x7f0e440cc1f0 2024-01-27T14:32:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.075+0000 7f0e4ba8e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4415de30 con 0x7f0e4406c820 2024-01-27T14:32:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.075+0000 7f0e4ba8e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415e0d0 con 0x7f0e441580f0 2024-01-27T14:32:32.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.078+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836812699 0 0) 0x7f1c90161510 con 0x7f1c900c5900 2024-01-27T14:32:32.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.078+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c78003520 con 0x7f1c900c5900 2024-01-27T14:32:32.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.078+0000 7f0e4982a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.079+0000 7f0e4982a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47534/0 (socket says 172.21.15.46:47534) 2024-01-27T14:32:32.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.079+0000 7f0e4982a640 1 -- 172.21.15.46:0/1242345650 learned_addr learned my addr 172.21.15.46:0/1242345650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.079+0000 7f0e4a02b640 1 --2- 172.21.15.46:0/1242345650 >> v2:172.21.15.46:3300/0 conn(0x7f0e4406c820 0x7f0e440c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.080+0000 7fb1b6e9b640 1 Processor -- start 2024-01-27T14:32:32.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.080+0000 7fb1b6e9b640 1 -- start start 2024-01-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.081+0000 7f0e4982a640 1 -- 172.21.15.46:0/1242345650 >> v2:172.21.15.46:3300/0 conn(0x7f0e4406c820 msgr2=0x7f0e440c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.081+0000 7f0e4982a640 1 --2- 172.21.15.46:0/1242345650 >> v2:172.21.15.46:3300/0 conn(0x7f0e4406c820 0x7f0e440c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.081+0000 7f0e4982a640 1 -- 172.21.15.46:0/1242345650 >> v1:172.21.15.73:6789/0 conn(0x7f0e440cc1f0 legacy=0x7f0e4406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.081+0000 7f0e4982a640 1 -- 172.21.15.46:0/1242345650 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4415e3b0 con 0x7f0e441580f0 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072297951 0 0) 0x7f1c78003520 con 0x7f1c900c5900 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 >> v2:172.21.15.46:3300/0 conn(0x7f1c900c5ce0 msgr2=0x7f1c901693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 --2- 172.21.15.46:0/2013797894 >> v2:172.21.15.46:3300/0 conn(0x7f1c900c5ce0 0x7f1c901693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 >> v1:172.21.15.46:6789/0 conn(0x7f1c900b0c80 legacy=0x7f1c9006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900c1880 con 0x7f1c900c5900 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f1c84001670 con 0x7f1c900c5900 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 >> v1:172.21.15.73:6789/0 conn(0x7f1c900c5900 legacy=0x7f1c901619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.081+0000 7fb1b6e9b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7fb1b6e9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb1b0071ac0 0x7fb1b0071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7fb1b6e9b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b0159be0 con 0x7fb1b006de80 2024-01-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7fb1b6e9b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b0071630 con 0x7fb1b0071ac0 2024-01-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.082+0000 7fb1b6e9b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0072490 con 0x7fb1b014f9d0 2024-01-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780039c0 0x7f1c78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 0x7f1c78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c78005180 0x7f1c7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9006e140 con 0x7f1c780039c0 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7800c080 con 0x7f1c780047c0 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7800c240 con 0x7f1c78005180 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.084+0000 7f0e4982a640 1 --2- 172.21.15.46:0/1242345650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009e50 tx=0x7f0e3c02bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48b526b0b72ad1b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1e4ca2e640 1 Processor -- start 2024-01-27T14:32:32.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.083+0000 7f1e4ca2e640 1 -- start start 2024-01-27T14:32:32.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.084+0000 7f1c8ffff640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780039c0 0x7f1c78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.084+0000 7f1e4ca2e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e400dd4c0 0x7f1e40050fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.084+0000 7f1e4ca2e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e400e6f40 0x7f1e40052790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.084+0000 7f1e4ca2e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400e3390 con 0x7f1e40052350 2024-01-27T14:32:32.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7f1e4ca2e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e400e3f10 con 0x7f1e400e6f40 2024-01-27T14:32:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7f1e4ca2e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400e35e0 con 0x7f1e400dd4c0 2024-01-27T14:32:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7fb1b4c37640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7fb1b4c37640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47536/0 (socket says 172.21.15.46:47536) 2024-01-27T14:32:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7fb1b4c37640 1 -- 172.21.15.46:0/3476785785 learned_addr learned my addr 172.21.15.46:0/3476785785 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7fb1b5438640 1 --2- 172.21.15.46:0/3476785785 >> v2:172.21.15.46:3300/0 conn(0x7fb1b0071ac0 0x7fb1b0071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.085+0000 7f1c94b46640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c78005180 0x7f1c7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.086+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 0x7f1c78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.088+0000 7f1e47fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e400e6f40 0x7f1e40052790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.088+0000 7f1e47fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e400e6f40 0x7f1e40052790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56562/0 (socket says 172.21.15.46:56562) 2024-01-27T14:32:32.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.088+0000 7f1e47fff640 1 -- 172.21.15.46:0/1780838022 learned_addr learned my addr 172.21.15.46:0/1780838022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.089+0000 7fadea815640 1 Processor -- start 2024-01-27T14:32:32.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.090+0000 7f0e48828640 1 -- 172.21.15.46:0/1242345650 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c02caa0 con 0x7f0e441580f0 2024-01-27T14:32:32.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.090+0000 7f0e48828640 1 -- 172.21.15.46:0/1242345650 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c02cc00 con 0x7f0e441580f0 2024-01-27T14:32:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.089+0000 7fadea815640 1 -- start start 2024-01-27T14:32:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.090+0000 7fadea815640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faddc0d5e40 0x7faddc007bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.090+0000 7fadea815640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faddc04d8c0 0x7faddc0e6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e48828640 1 -- 172.21.15.46:0/1242345650 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0343f0 con 0x7f0e441580f0 2024-01-27T14:32:32.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1242345650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 msgr2=0x7f0e440cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1242345650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009e50 tx=0x7f0e3c02bf00 comp rx=0 tx=0).stop 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c8f7fe640 1 -- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c78005180 msgr2=0x7f1c7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c78005180 0x7f1c7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c8f7fe640 1 -- 172.21.15.46:0/2013797894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780039c0 msgr2=0x7f1c78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780039c0 0x7f1c78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1242345650 shutdown_connections 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1242345650 >> v2:172.21.15.46:3300/0 conn(0x7f0e4406c820 0x7f0e440c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1242345650 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e440cbcb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1242345650 >> 172.21.15.46:0/1242345650 conn(0x7f0e44071fd0 msgr2=0x7f0e440723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c94b46640 1 -- 172.21.15.46:0/2013797894 reap_dead start 2024-01-27T14:32:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f1c8f7fe640 1 -- 172.21.15.46:0/2013797894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78003520 con 0x7f1c780047c0 2024-01-27T14:32:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1242345650 shutdown_connections 2024-01-27T14:32:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7fadea815640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0dca20 con 0x7faddc048010 2024-01-27T14:32:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7fadea815640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc034cb0 con 0x7faddc0d5e40 2024-01-27T14:32:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7fadea815640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc047290 con 0x7faddc04d8c0 2024-01-27T14:32:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.091+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1242345650 wait complete. 2024-01-27T14:32:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.092+0000 7fb1b4c37640 1 -- 172.21.15.46:0/3476785785 >> v2:172.21.15.46:3300/0 conn(0x7fb1b0071ac0 msgr2=0x7fb1b0071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.092+0000 7fb1b4c37640 1 --2- 172.21.15.46:0/3476785785 >> v2:172.21.15.46:3300/0 conn(0x7fb1b0071ac0 0x7fb1b0071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.092+0000 7fb1b4c37640 1 -- 172.21.15.46:0/3476785785 >> v1:172.21.15.46:6789/0 conn(0x7fb1b006de80 legacy=0x7fb1b00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.092+0000 7fb1b4c37640 1 -- 172.21.15.46:0/3476785785 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0159340 con 0x7fb1b014f9d0 2024-01-27T14:32:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f0e4ba8e640 1 Processor -- start 2024-01-27T14:32:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f0e4ba8e640 1 -- start start 2024-01-27T14:32:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f1e47fff640 1 -- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e400dd4c0 msgr2=0x7f1e40050fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f1e47fff640 1 --2- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e400dd4c0 0x7f1e40050fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f1e47fff640 1 -- 172.21.15.46:0/1780838022 >> v1:172.21.15.46:6789/0 conn(0x7f1e40052350 legacy=0x7f1e400e6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.093+0000 7f1e47fff640 1 -- 172.21.15.46:0/1780838022 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400e38c0 con 0x7f1e400e6f40 2024-01-27T14:32:32.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.094+0000 7fadea014640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faddc04d8c0 0x7faddc0e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.094+0000 7f0e4ba8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4406c820 0x7f0e441530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7f0e4ba8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cc1f0 0x7f0e441f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7f0e4ba8e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e441f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7f0e4ba8e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441544d0 con 0x7f0e4406c820 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7f0e4ba8e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440cd4e0 con 0x7f0e440cc1f0 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7f0e4ba8e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44150000 con 0x7f0e441580f0 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7fadea014640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faddc04d8c0 0x7faddc0e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56576/0 (socket says 172.21.15.46:56576) 2024-01-27T14:32:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.095+0000 7fadea014640 1 -- 172.21.15.46:0/534069011 learned_addr learned my addr 172.21.15.46:0/534069011 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.097+0000 7f1e47fff640 1 --2- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e40052790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009870 tx=0x7f1e3c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8697dfc09f9cd51 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.097+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 0x7f1c78004c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c90070a80 tx=0x7f1c780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6613e42c2f8429ab server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.099+0000 7fadea014640 1 -- 172.21.15.46:0/534069011 >> v2:172.21.15.46:3300/0 conn(0x7faddc0d5e40 msgr2=0x7faddc007bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.099+0000 7fadea014640 1 --2- 172.21.15.46:0/534069011 >> v2:172.21.15.46:3300/0 conn(0x7faddc0d5e40 0x7faddc007bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.099+0000 7fadea014640 1 -- 172.21.15.46:0/534069011 >> v1:172.21.15.46:6789/0 conn(0x7faddc048010 legacy=0x7faddc0462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.099+0000 7fadea014640 1 -- 172.21.15.46:0/534069011 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0dc480 con 0x7faddc04d8c0 2024-01-27T14:32:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.100+0000 7f0e4a02b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e441f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.101+0000 7f0e4a02b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e441f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47550/0 (socket says 172.21.15.46:47550) 2024-01-27T14:32:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.101+0000 7f0e4a02b640 1 -- 172.21.15.46:0/1362873318 learned_addr learned my addr 172.21.15.46:0/1362873318 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.102+0000 7fadea014640 1 --2- 172.21.15.46:0/534069011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc04d8c0 0x7faddc0e6380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fade4068f40 tx=0x7fade4069620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbcba31b7d570645 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.104+0000 7fb1b4c37640 1 --2- 172.21.15.46:0/3476785785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009870 tx=0x7fb1a402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2b209f822a5f48 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.104+0000 7f0fbcf78640 1 Processor -- start 2024-01-27T14:32:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.104+0000 7f0fbcf78640 1 -- start start 2024-01-27T14:32:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.104+0000 7f0e4982a640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4406c820 0x7f0e441530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.105+0000 7f0fbcf78640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.105+0000 7f0fbcf78640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0fb80c9380 0x7f0fb815b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.105+0000 7f0fbcf78640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb815aad0 con 0x7f0fb80ca3d0 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.105+0000 7f0fbcf78640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb8158500 con 0x7f0fb80c9380 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.105+0000 7f0fbcf78640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb815b090 con 0x7f0fb8151810 2024-01-27T14:32:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.106+0000 7f0e4a02b640 1 -- 172.21.15.46:0/1362873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cc1f0 msgr2=0x7f0e441f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.106+0000 7f0e4a02b640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cc1f0 0x7f0e441f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.106+0000 7f0e4a02b640 1 -- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4406c820 msgr2=0x7f0e441530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.106+0000 7f0e4a02b640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e4406c820 0x7f0e441530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.106+0000 7f0e4a02b640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009b30 con 0x7f0e441580f0 2024-01-27T14:32:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.109+0000 7f1e467fc640 1 -- 172.21.15.46:0/1780838022 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c030840 con 0x7f1e400e6f40 2024-01-27T14:32:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.109+0000 7f1e467fc640 1 -- 172.21.15.46:0/1780838022 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0309a0 con 0x7f1e400e6f40 2024-01-27T14:32:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.109+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800052d0 con 0x7f1c780047c0 2024-01-27T14:32:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.109+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8002e050 con 0x7f1c780047c0 2024-01-27T14:32:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.109+0000 7f1c8effd640 1 -- 172.21.15.46:0/2013797894 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80003830 con 0x7f1c780047c0 2024-01-27T14:32:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e467fc640 1 -- 172.21.15.46:0/1780838022 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c030d30 con 0x7f1e400e6f40 2024-01-27T14:32:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 msgr2=0x7f1e40052790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e40052790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009870 tx=0x7f1e3c02b980 comp rx=0 tx=0).stop 2024-01-27T14:32:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 -- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 msgr2=0x7f1c78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/1780838022 shutdown_connections 2024-01-27T14:32:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e40052790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/1780838022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e400dd4c0 0x7f1e40050fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 0x7f1c78004c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c90070a80 tx=0x7f1c780057f0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/1780838022 >> 172.21.15.46:0/1780838022 conn(0x7f1e4000c370 msgr2=0x7f1e4000c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 -- 172.21.15.46:0/2013797894 shutdown_connections 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 --2- 172.21.15.46:0/2013797894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c780047c0 0x7f1c78004c40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 -- 172.21.15.46:0/2013797894 >> 172.21.15.46:0/2013797894 conn(0x7f1c900c7a00 msgr2=0x7f1c900c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 -- 172.21.15.46:0/2013797894 shutdown_connections 2024-01-27T14:32:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1c965a9640 1 -- 172.21.15.46:0/2013797894 wait complete. 2024-01-27T14:32:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/1780838022 shutdown_connections 2024-01-27T14:32:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.110+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/1780838022 wait complete. 2024-01-27T14:32:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f1e4ca2e640 1 Processor -- start 2024-01-27T14:32:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f1e4ca2e640 1 -- start start 2024-01-27T14:32:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f0fb659c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f1c965a9640 1 Processor -- start 2024-01-27T14:32:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7fbe45c90640 1 Processor -- start 2024-01-27T14:32:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7fbe45c90640 1 -- start start 2024-01-27T14:32:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f1c965a9640 1 -- start start 2024-01-27T14:32:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7fb1af7fe640 1 -- 172.21.15.46:0/3476785785 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4031640 con 0x7fb1b014f9d0 2024-01-27T14:32:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7fb1af7fe640 1 -- 172.21.15.46:0/3476785785 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a40317a0 con 0x7fb1b014f9d0 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 0x7f1e400d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e400dd4c0 0x7f1e4017b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e4017b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4016c990 con 0x7f1e400dd4c0 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4017afb0 con 0x7f1e400e6f40 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7f1e4ca2e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400e6ab0 con 0x7f1e40052350 2024-01-27T14:32:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.113+0000 7fb1af7fe640 1 -- 172.21.15.46:0/3476785785 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4031b30 con 0x7fb1b014f9d0 2024-01-27T14:32:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.112+0000 7f0e4a02b640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e441f7230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d800 tx=0x7f0e3400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fbe45c90640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe400c8630 0x7fbe4006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fbe45c90640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe40150d50 con 0x7fbe40150970 2024-01-27T14:32:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fbe45c90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400c0fa0 con 0x7fbe40156580 2024-01-27T14:32:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fbe45c90640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400c1e80 con 0x7fbe400c8630 2024-01-27T14:32:32.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780047c0 0x7f1c90160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f0fb659c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47558/0 (socket says 172.21.15.46:47558) 2024-01-27T14:32:32.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f0fb659c640 1 -- 172.21.15.46:0/2328082659 learned_addr learned my addr 172.21.15.46:0/2328082659 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/3476785785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 msgr2=0x7fb1b0158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/3476785785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009870 tx=0x7fb1a402b8f0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c901486c0 0x7f1c9014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 0x7f1c901425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/3476785785 shutdown_connections 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/3476785785 >> v2:172.21.15.46:3300/0 conn(0x7fb1b0071ac0 0x7fb1b0071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/3476785785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0158c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/3476785785 >> 172.21.15.46:0/3476785785 conn(0x7fb1b00c7a00 msgr2=0x7fb1b00c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90142b20 con 0x7f1c780047c0 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c9e30 con 0x7f1c90142160 2024-01-27T14:32:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.114+0000 7f1c965a9640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900ca9b0 con 0x7f1c901486c0 2024-01-27T14:32:32.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.115+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/3476785785 shutdown_connections 2024-01-27T14:32:32.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.115+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/3476785785 wait complete. 2024-01-27T14:32:32.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.115+0000 7f0fb6d9d640 1 --2- 172.21.15.46:0/2328082659 >> v2:172.21.15.46:3300/0 conn(0x7f0fb80c9380 0x7f0fb815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.116+0000 7f1e477fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 0x7f1e400d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7f1e477fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 0x7f1e400d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47562/0 (socket says 172.21.15.46:47562) 2024-01-27T14:32:32.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7fb1b6e9b640 1 Processor -- start 2024-01-27T14:32:32.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7f1e477fe640 1 -- 172.21.15.46:0/121109153 learned_addr learned my addr 172.21.15.46:0/121109153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7ff50e60e640 1 Processor -- start 2024-01-27T14:32:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7fb1b6e9b640 1 -- start start 2024-01-27T14:32:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7ff50e60e640 1 -- start start 2024-01-27T14:32:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7fade8811640 1 -- 172.21.15.46:0/534069011 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40ab7d0 con 0x7faddc04d8c0 2024-01-27T14:32:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7fade8811640 1 -- 172.21.15.46:0/534069011 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40a9050 con 0x7faddc04d8c0 2024-01-27T14:32:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.117+0000 7fade8811640 1 -- 172.21.15.46:0/534069011 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40abbf0 con 0x7faddc04d8c0 2024-01-27T14:32:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7ff50e60e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff50815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7ff50e60e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff50806f770 0x7ff5080c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7ff50e60e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5080c65e0 con 0x7ff5080c5880 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7ff50e60e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50815ec30 con 0x7ff50806f770 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7ff50e60e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff508070260 con 0x7ff50806f390 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 -- 172.21.15.46:0/534069011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc04d8c0 msgr2=0x7faddc0e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 --2- 172.21.15.46:0/534069011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc04d8c0 0x7faddc0e6380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fade4068f40 tx=0x7fade4069620 comp rx=0 tx=0).stop 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 -- 172.21.15.46:0/534069011 shutdown_connections 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 --2- 172.21.15.46:0/534069011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc04d8c0 0x7faddc0e6380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 --2- 172.21.15.46:0/534069011 >> v2:172.21.15.46:3300/0 conn(0x7faddc0d5e40 0x7faddc007bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 -- 172.21.15.46:0/534069011 >> 172.21.15.46:0/534069011 conn(0x7faddc051310 msgr2=0x7faddc051720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fb1b6e9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 0x7fb1b01ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 -- 172.21.15.46:0/534069011 shutdown_connections 2024-01-27T14:32:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.118+0000 7fadea815640 1 -- 172.21.15.46:0/534069011 wait complete. 2024-01-27T14:32:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7fb1b6e9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b0071ac0 0x7fb1b00c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7fb1b6e9b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7fb1b6e9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c3890 con 0x7fb1b006de80 2024-01-27T14:32:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7fb1b6e9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0156430 con 0x7fb1b0071ac0 2024-01-27T14:32:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7fb1b6e9b640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01562a0 con 0x7fb1b014f9d0 2024-01-27T14:32:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.119+0000 7f1e46ffd640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e400dd4c0 0x7f1e4017b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7f1c94b46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 0x7f1c901425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7fadea815640 1 Processor -- start 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7fadea815640 1 -- start start 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7fadea815640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faddc048010 0x7faddc178990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7fadea815640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc04d8c0 0x7faddc008020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.120+0000 7fadea815640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 0x7faddc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7fadea815640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0cfc00 con 0x7faddc04d8c0 2024-01-27T14:32:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7fadea815640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0d14c0 con 0x7faddc0d5e40 2024-01-27T14:32:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7fadea815640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0cf430 con 0x7faddc048010 2024-01-27T14:32:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f1c94b46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 0x7f1c901425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56612/0 (socket says 172.21.15.46:56612) 2024-01-27T14:32:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f1c94b46640 1 -- 172.21.15.46:0/2143011392 learned_addr learned my addr 172.21.15.46:0/2143011392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c901486c0 0x7f1c9014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f0fb659c640 1 -- 172.21.15.46:0/2328082659 >> v2:172.21.15.46:3300/0 conn(0x7f0fb80c9380 msgr2=0x7f0fb815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f0fb659c640 1 --2- 172.21.15.46:0/2328082659 >> v2:172.21.15.46:3300/0 conn(0x7f0fb80c9380 0x7f0fb815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f0fb659c640 1 -- 172.21.15.46:0/2328082659 >> v1:172.21.15.73:6789/0 conn(0x7f0fb80ca3d0 legacy=0x7f0fb8070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.121+0000 7f0fb659c640 1 -- 172.21.15.46:0/2328082659 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8157c60 con 0x7f0fb8151810 2024-01-27T14:32:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.124+0000 7fbe3ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe40156580 0x7fbe40160e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:37120/0 (socket says 172.21.15.46:37120) 2024-01-27T14:32:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.124+0000 7fbe3ffff640 1 -- 172.21.15.46:0/616709056 learned_addr learned my addr 172.21.15.46:0/616709056 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e47fff640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e4017b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7fb1b4c37640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 0x7fb1b01ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e477fe640 1 -- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 msgr2=0x7f1e4017b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e477fe640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e400e6f40 0x7f1e4017b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e477fe640 1 -- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e400dd4c0 msgr2=0x7f1e4017b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e477fe640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e400dd4c0 0x7f1e4017b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.125+0000 7f1e477fe640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0094d0 con 0x7f1e40052350 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.128+0000 7f1c94b46640 1 -- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c901486c0 msgr2=0x7f1c9014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.128+0000 7f1c94b46640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c901486c0 0x7f1c9014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.128+0000 7f1c94b46640 1 -- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780047c0 msgr2=0x7f1c90160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.128+0000 7f1c94b46640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c780047c0 0x7f1c90160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.128+0000 7f1c94b46640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90160cf0 con 0x7f1c90142160 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.129+0000 7fb1b4c37640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 0x7fb1b01ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53084/0 (socket says 172.21.15.46:53084) 2024-01-27T14:32:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.129+0000 7fb1b4c37640 1 -- 172.21.15.46:0/2469710178 learned_addr learned my addr 172.21.15.46:0/2469710178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.130+0000 7f1e477fe640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 0x7f1e400d1800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b4a0 tx=0x7f1e3400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.131+0000 7f0fb659c640 1 --2- 172.21.15.46:0/2328082659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009870 tx=0x7f0fa002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44db7036b1dba07b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.131+0000 7fadea014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 0x7faddc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.131+0000 7fbe3effd640 1 --2- 172.21.15.46:0/616709056 >> v2:172.21.15.46:3300/0 conn(0x7fbe400c8630 0x7fbe4006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7fb1b4c37640 1 -- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 msgr2=0x7fb1b0140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7fb1b4c37640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b014f9d0 0x7fb1b0140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7fb1b4c37640 1 -- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b0071ac0 msgr2=0x7fb1b00c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7fb1b4c37640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b0071ac0 0x7fb1b00c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7fb1b4c37640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40094d0 con 0x7fb1b006de80 2024-01-27T14:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400b6c0 con 0x7f0e441580f0 2024-01-27T14:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.134+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400b840 con 0x7f0e441580f0 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.135+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400bbf0 con 0x7f0e441580f0 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.135+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4414ed20 con 0x7f0e441580f0 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.135+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e441540f0 con 0x7f0e441580f0 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.135+0000 7fadea014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 0x7faddc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56628/0 (socket says 172.21.15.46:56628) 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.135+0000 7fadea014640 1 -- 172.21.15.46:0/3688259795 learned_addr learned my addr 172.21.15.46:0/3688259795 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.136+0000 7f1c94b46640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 0x7f1c901425e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c8880 tx=0x7f1c8800f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.136+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e4415e970 con 0x7f0e441580f0 2024-01-27T14:32:32.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.139+0000 7ff507fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff50815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fbe3effd640 1 -- 172.21.15.46:0/616709056 >> v1:172.21.15.73:6789/0 conn(0x7fbe40156580 legacy=0x7fbe40160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fbe3effd640 1 -- 172.21.15.46:0/616709056 >> v1:172.21.15.46:6789/0 conn(0x7fbe40150970 legacy=0x7fbe400c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fbe3effd640 1 -- 172.21.15.46:0/616709056 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400c1200 con 0x7fbe400c8630 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fadea014640 1 -- 172.21.15.46:0/3688259795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faddc048010 msgr2=0x7faddc178990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fadea014640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faddc048010 0x7faddc178990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fadea014640 1 -- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc04d8c0 msgr2=0x7faddc008020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fadea014640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc04d8c0 0x7faddc008020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fb1b4c37640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 0x7fb1b01ef260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40090b0 tx=0x7fb1a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7fadea014640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade404f940 con 0x7faddc0d5e40 2024-01-27T14:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7f0fb5d9b640 1 -- 172.21.15.46:0/2328082659 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa002f840 con 0x7f0fb8151810 2024-01-27T14:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7f0fb5d9b640 1 -- 172.21.15.46:0/2328082659 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa002f9a0 con 0x7f0fb8151810 2024-01-27T14:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.140+0000 7f0fb5d9b640 1 -- 172.21.15.46:0/2328082659 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa002fd30 con 0x7f0fb8151810 2024-01-27T14:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 -- 172.21.15.46:0/2328082659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 msgr2=0x7f0fb80ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/2328082659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009870 tx=0x7f0fa002ba20 comp rx=0 tx=0).stop 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 -- 172.21.15.46:0/2328082659 shutdown_connections 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/2328082659 >> v2:172.21.15.46:3300/0 conn(0x7f0fb80c9380 0x7f0fb815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/2328082659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb80ccd10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 -- 172.21.15.46:0/2328082659 >> 172.21.15.46:0/2328082659 conn(0x7f0fb8066c80 msgr2=0x7f0fb806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 -- 172.21.15.46:0/2328082659 shutdown_connections 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.141+0000 7f0fbcf78640 1 -- 172.21.15.46:0/2328082659 wait complete. 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 Processor -- start 2024-01-27T14:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 -- start start 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb80c9380 0x7f0fb8153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fb80ca3d0 0x7f0fb80c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb8147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81540b0 con 0x7f0fb80ca3d0 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8154430 con 0x7f0fb80c9380 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.143+0000 7f0fbcf78640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81476c0 con 0x7f0fb8151810 2024-01-27T14:32:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.144+0000 7ff5077fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff50806f770 0x7ff5080c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.146+0000 7ff5077fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff50806f770 0x7ff5080c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56614/0 (socket says 172.21.15.46:56614) 2024-01-27T14:32:32.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.146+0000 7ff5077fe640 1 -- 172.21.15.46:0/1377994665 learned_addr learned my addr 172.21.15.46:0/1377994665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.146+0000 7fadea014640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 0x7faddc0cbc50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fade404ef70 tx=0x7fade4069320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.147+0000 7fbe3effd640 1 --2- 172.21.15.46:0/616709056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe400c8630 0x7fbe4006d8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe300097a0 tx=0x7fbe3002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2a6e7758cbc8b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.148+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800e040 con 0x7f1c90142160 2024-01-27T14:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.148+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8800f040 con 0x7f1c90142160 2024-01-27T14:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.148+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c900ca080 con 0x7f1c90142160 2024-01-27T14:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.148+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88015430 con 0x7f1c90142160 2024-01-27T14:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.148+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c900ca640 con 0x7f1c90142160 2024-01-27T14:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.149+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c901611a0 con 0x7f1c90142160 2024-01-27T14:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7ff5077fe640 1 -- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 msgr2=0x7ff50815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7ff5077fe640 1 --2- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff50815e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7ff5077fe640 1 -- 172.21.15.46:0/1377994665 >> v1:172.21.15.46:6789/0 conn(0x7ff5080c5880 legacy=0x7ff508157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a403a970 con 0x7fb1b006de80 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7ff5077fe640 1 -- 172.21.15.46:0/1377994665 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080c4580 con 0x7ff50806f770 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a403aad0 con 0x7fb1b006de80 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a403a970 con 0x7fb1b006de80 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00c4160 con 0x7fb1b006de80 2024-01-27T14:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.150+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b0156620 con 0x7fb1b006de80 2024-01-27T14:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1b00712c0 con 0x7fb1b006de80 2024-01-27T14:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34010610 con 0x7f1e40052350 2024-01-27T14:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34010770 con 0x7f1e40052350 2024-01-27T14:32:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34010b20 con 0x7f1e40052350 2024-01-27T14:32:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4017d180 con 0x7f1e40052350 2024-01-27T14:32:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.151+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4017a680 con 0x7f1e40052350 2024-01-27T14:32:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.152+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e40037880 con 0x7f1e40052350 2024-01-27T14:32:32.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.156+0000 7f0fb6d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb8147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.157+0000 7f0fb6d9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb8147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47610/0 (socket says 172.21.15.46:47610) 2024-01-27T14:32:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.157+0000 7f0fb6d9d640 1 -- 172.21.15.46:0/523697986 learned_addr learned my addr 172.21.15.46:0/523697986 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.164+0000 7f0faffff640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fb80ca3d0 0x7f0fb80c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.173+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0e3400bd50 con 0x7f0e441580f0 2024-01-27T14:32:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.173+0000 7f0e3a7fc640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e2806af50 0x7f0e2806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.173+0000 7f0e4982a640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e2806af50 0x7f0e2806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.174+0000 7f0e4982a640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e2806af50 0x7f0e2806d410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c035000 tx=0x7f0e3c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.175+0000 7f0fb6d9d640 1 -- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb80c9380 msgr2=0x7f0fb8153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.175+0000 7f0fb6d9d640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fb80c9380 0x7f0fb8153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.175+0000 7f0fb6d9d640 1 -- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fb80ca3d0 msgr2=0x7f0fb80c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.175+0000 7f0fb6d9d640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fb80ca3d0 0x7f0fb80c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.175+0000 7f0fb6d9d640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00094d0 con 0x7f0fb8151810 2024-01-27T14:32:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.177+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb1a402f050 con 0x7fb1b006de80 2024-01-27T14:32:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.177+0000 7fb1ad7fa640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb19406d1b0 0x7fb19406f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.177+0000 7fb1affff640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb19406d1b0 0x7fb19406f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.178+0000 7fb1affff640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb19406d1b0 0x7fb19406f670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00b1210 tx=0x7fb19c006ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.183+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fb1a407a8f0 con 0x7fb1b006de80 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.183+0000 7fb1ad7fa640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fb194077470 0x7fb194079910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.183+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb194079fe0 con 0x7fb194077470 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.183+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a403a970 con 0x7fb1b006de80 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.183+0000 7fb1b5438640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fb194077470 0x7fb194079910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.184+0000 7fb1b5438640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fb194077470 0x7fb194079910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.184+0000 7fbe3e7fc640 1 -- 172.21.15.46:0/616709056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3002f810 con 0x7fbe400c8630 2024-01-27T14:32:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.184+0000 7fbe3e7fc640 1 -- 172.21.15.46:0/616709056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3002f970 con 0x7fbe400c8630 2024-01-27T14:32:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.184+0000 7fbe3e7fc640 1 -- 172.21.15.46:0/616709056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3002f810 con 0x7fbe400c8630 2024-01-27T14:32:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.184+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== osd.7 v2:172.21.15.73:6824/944085099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb194079fe0 con 0x7fb194077470 2024-01-27T14:32:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1c88015590 con 0x7f1c90142160 2024-01-27T14:32:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 -- 172.21.15.46:0/616709056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe400c8630 msgr2=0x7fbe4006d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 --2- 172.21.15.46:0/616709056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe400c8630 0x7fbe4006d8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe300097a0 tx=0x7fbe3002b9f0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 -- 172.21.15.46:0/616709056 shutdown_connections 2024-01-27T14:32:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 --2- 172.21.15.46:0/616709056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe400c8630 0x7fbe4006d8b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 -- 172.21.15.46:0/616709056 >> 172.21.15.46:0/616709056 conn(0x7fbe400cbf80 msgr2=0x7fbe400cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7f1c8cff9640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1c7c06af20 0x7f1c7c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40adb40 con 0x7faddc0d5e40 2024-01-27T14:32:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fbe45c90640 1 -- 172.21.15.46:0/616709056 shutdown_connections 2024-01-27T14:32:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc037160 con 0x7faddc0d5e40 2024-01-27T14:32:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.185+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc0cf640 con 0x7faddc0d5e40 2024-01-27T14:32:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.186+0000 7f1c8ffff640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1c7c06af20 0x7f1c7c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.186+0000 7fbe45c90640 1 -- 172.21.15.46:0/616709056 wait complete. 2024-01-27T14:32:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.186+0000 7f1c8ffff640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1c7c06af20 0x7f1c7c06d3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005900 tx=0x7f1c84000ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.186+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faddc047810 con 0x7faddc0d5e40 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.187+0000 7fbe45c90640 1 Processor -- start 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.187+0000 7fbe45c90640 1 -- start start 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe40150970 0x7fbe400c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe40156580 0x7fbe400c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 0x7fbe401346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c4ab0 con 0x7fbe40153c70 2024-01-27T14:32:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0e34015e40 con 0x7f0e441580f0 2024-01-27T14:32:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401536e0 con 0x7fbe40156580 2024-01-27T14:32:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7fbe45c90640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40136dd0 con 0x7fbe40150970 2024-01-27T14:32:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7f0e3a7fc640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7f0e28074630 0x7f0e28076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e280771a0 con 0x7f0e28074630 2024-01-27T14:32:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.188+0000 7f0e49029640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7f0e28074630 0x7f0e28076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.189+0000 7fbe3ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 0x7fbe401346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.189+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e34055380 con 0x7f0e441580f0 2024-01-27T14:32:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.189+0000 7f0e49029640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7f0e28074630 0x7f0e28076ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.189+0000 7fbe3ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 0x7fbe401346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53112/0 (socket says 172.21.15.46:53112) 2024-01-27T14:32:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.189+0000 7fbe3ffff640 1 -- 172.21.15.46:0/2488991302 learned_addr learned my addr 172.21.15.46:0/2488991302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.190+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== osd.1 v2:172.21.15.46:6802/1737720199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e280771a0 con 0x7f0e28074630 2024-01-27T14:32:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.190+0000 7f0fb6d9d640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb8147b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000efc0 tx=0x7f0fb000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.193+0000 7fbe3ffff640 1 -- 172.21.15.46:0/2488991302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe40150970 msgr2=0x7fbe400c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.193+0000 7fbe3ffff640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe40150970 0x7fbe400c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.193+0000 7fbe3ffff640 1 -- 172.21.15.46:0/2488991302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe40156580 msgr2=0x7fbe400c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.193+0000 7fbe3ffff640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe40156580 0x7fbe400c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.193+0000 7fbe3ffff640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009400 con 0x7fbe40153c70 2024-01-27T14:32:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.194+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1c88059aa0 con 0x7f1c90142160 2024-01-27T14:32:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.194+0000 7f1c8cff9640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f1c7c074600 0x7f1c7c076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.194+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c7c077170 con 0x7f1c7c074600 2024-01-27T14:32:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.194+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f1c7c074600 0x7f1c7c076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.195+0000 7f1c8f7fe640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f1c7c074600 0x7f1c7c076aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.195+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== osd.4 v2:172.21.15.73:6808/348968633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1c7c077170 con 0x7f1c7c074600 2024-01-27T14:32:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.196+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40adca0 con 0x7faddc0d5e40 2024-01-27T14:32:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.196+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b7670 con 0x7faddc0d5e40 2024-01-27T14:32:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.196+0000 7fbe3ffff640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 0x7fbe401346b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800caa0 tx=0x7fbe3800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.196+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c880556e0 con 0x7f1c90142160 2024-01-27T14:32:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.200+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 --> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1b0159900 con 0x7fb194077470 2024-01-27T14:32:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.200+0000 7fb1ad7fa640 1 -- 172.21.15.46:0/2469710178 <== osd.7 v2:172.21.15.73:6824/944085099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1a800f040 con 0x7fb194077470 2024-01-27T14:32:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.200+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fb194077470 msgr2=0x7fb194079910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.200+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fb194077470 0x7fb194079910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.200+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800aba0 con 0x7fbe40153c70 2024-01-27T14:32:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe400c4140 con 0x7fbe40153c70 2024-01-27T14:32:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb19406d1b0 msgr2=0x7fb19406f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb19406d1b0 0x7fb19406f670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00b1210 tx=0x7fb19c006ba0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 msgr2=0x7fb1b01ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 --2- 172.21.15.46:0/2469710178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1b006de80 0x7fb1b01ef260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40090b0 tx=0x7fb1a40046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b5438640 1 -- 172.21.15.46:0/2469710178 reap_dead start 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 shutdown_connections 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 >> 172.21.15.46:0/2469710178 conn(0x7fb1b00c7a00 msgr2=0x7fb1b00c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe40145470 con 0x7fbe40153c70 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 shutdown_connections 2024-01-27T14:32:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fb1b6e9b640 1 -- 172.21.15.46:0/2469710178 wait complete. 2024-01-27T14:32:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.201+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3800ad00 con 0x7fbe40153c70 2024-01-27T14:32:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.202+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800aba0 con 0x7fbe40153c70 2024-01-27T14:32:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.202+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe20001030 con 0x7fbe40153c70 2024-01-27T14:32:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.204+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1e34010c80 con 0x7f1e40052350 2024-01-27T14:32:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.205+0000 7f1e33fff640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2c06af50 0x7f1e2c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.205+0000 7f1e46ffd640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2c06af50 0x7f1e2c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.205+0000 7f1e46ffd640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2c06af50 0x7f1e2c06d410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e48000b60 tx=0x7f1e480663e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1e34058380 con 0x7f1e40052350 2024-01-27T14:32:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7f1e33fff640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f1e2c074630 0x7f1e2c076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e2c0771a0 con 0x7f1e2c074630 2024-01-27T14:32:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7ff5077fe640 1 --2- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5080c5340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009870 tx=0x7ff4fc02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe1cc813aeee461 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7f1e47fff640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f1e2c074630 0x7f1e2c076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.209+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e340092d0 con 0x7f1e40052350 2024-01-27T14:32:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.210+0000 7f1e47fff640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f1e2c074630 0x7f1e2c076ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.210+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== osd.3 v2:172.21.15.46:6826/2789936740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e2c0771a0 con 0x7f1e2c074630 2024-01-27T14:32:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.213+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ced0 con 0x7f0fb8151810 2024-01-27T14:32:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.213+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000f040 con 0x7f0fb8151810 2024-01-27T14:32:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.213+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb814a3b0 con 0x7f0fb8151810 2024-01-27T14:32:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.213+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb8152ef0 con 0x7f0fb8151810 2024-01-27T14:32:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.214+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00146c0 con 0x7f0fb8151810 2024-01-27T14:32:32.213 INFO:teuthology.orchestra.run.smithi046.stdout:64424509456 2024-01-27T14:32:32.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-27T14:32:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.216+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fb815ad20 con 0x7f0fb8151810 2024-01-27T14:32:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.219+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 --> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c900c1e40 con 0x7f1c7c074600 2024-01-27T14:32:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c8cff9640 1 -- 172.21.15.46:0/2143011392 <== osd.4 v2:172.21.15.73:6808/348968633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c800053b0 con 0x7f1c7c074600 2024-01-27T14:32:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f1c7c074600 msgr2=0x7f1c7c076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f1c7c074600 0x7f1c7c076aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1c7c06af20 msgr2=0x7f1c7c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1c7c06af20 0x7f1c7c06d3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005900 tx=0x7f1c84000ed0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 msgr2=0x7f1c901425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 --2- 172.21.15.46:0/2143011392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c90142160 0x7f1c901425e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c8880 tx=0x7f1c8800f580 comp rx=0 tx=0).stop 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c94b46640 1 -- 172.21.15.46:0/2143011392 reap_dead start 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 shutdown_connections 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 >> 172.21.15.46:0/2143011392 conn(0x7f1c900c7a00 msgr2=0x7f1c90071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.220+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 shutdown_connections 2024-01-27T14:32:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.221+0000 7f1c965a9640 1 -- 172.21.15.46:0/2143011392 wait complete. 2024-01-27T14:32:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.223+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 --> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e44154610 con 0x7f0e28074630 2024-01-27T14:32:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.223+0000 7f0e3a7fc640 1 -- 172.21.15.46:0/1362873318 <== osd.1 v2:172.21.15.46:6802/1737720199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e44154610 con 0x7f0e28074630 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fade40b4040 con 0x7faddc0d5e40 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7f0e28074630 msgr2=0x7f0e28076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7f0e28074630 0x7f0e28076ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e2806af50 msgr2=0x7f0e2806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e2806af50 0x7f0e2806d410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c035000 tx=0x7f0e3c030000 comp rx=0 tx=0).stop 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 msgr2=0x7f0e441f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4ba8e640 1 --2- 172.21.15.46:0/1362873318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e441580f0 0x7f0e441f7230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d800 tx=0x7f0e3400dcc0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.224+0000 7f0e4a02b640 1 -- 172.21.15.46:0/1362873318 reap_dead start 2024-01-27T14:32:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7fadda7fc640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fadc806aed0 0x7fadc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 shutdown_connections 2024-01-27T14:32:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 >> 172.21.15.46:0/1362873318 conn(0x7f0e44071fd0 msgr2=0x7f0e440c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 shutdown_connections 2024-01-27T14:32:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7fade9813640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fadc806aed0 0x7fadc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.225+0000 7f0e4ba8e640 1 -- 172.21.15.46:0/1362873318 wait complete. 2024-01-27T14:32:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.226+0000 7fade9813640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fadc806aed0 0x7fadc806d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fade0009670 tx=0x7fade0006bf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.231+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbe38007070 con 0x7fbe40153c70 2024-01-27T14:32:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fade40f4820 con 0x7faddc0d5e40 2024-01-27T14:32:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fadda7fc640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7fadc8074530 0x7fadc80769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadc80770a0 con 0x7fadc8074530 2024-01-27T14:32:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fbe27fff640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbe2c06af60 0x7fbe2c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 --> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e4017b0f0 con 0x7f1e2c074630 2024-01-27T14:32:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fbe3f7fe640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbe2c06af60 0x7fbe2c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.232+0000 7fade9012640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7fadc8074530 0x7fadc80769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e33fff640 1 -- 172.21.15.46:0/121109153 <== osd.3 v2:172.21.15.46:6826/2789936740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e3c040040 con 0x7f1e2c074630 2024-01-27T14:32:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fade40f0460 con 0x7faddc0d5e40 2024-01-27T14:32:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7fbe3f7fe640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbe2c06af60 0x7fbe2c06d420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe34000f60 tx=0x7fbe340079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7fade9012640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7fadc8074530 0x7fadc80769d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f1e2c074630 msgr2=0x7f1e2c076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f1e2c074630 0x7f1e2c076ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2c06af50 msgr2=0x7f1e2c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1e2c06af50 0x7f1e2c06d410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e48000b60 tx=0x7f1e480663e0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 msgr2=0x7f1e400d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e4ca2e640 1 --2- 172.21.15.46:0/121109153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e40052350 0x7f1e400d1800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b4a0 tx=0x7f1e3400b960 comp rx=0 tx=0).stop 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.233+0000 7f1e47fff640 1 -- 172.21.15.46:0/121109153 reap_dead start 2024-01-27T14:32:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.234+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 shutdown_connections 2024-01-27T14:32:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.234+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 >> 172.21.15.46:0/121109153 conn(0x7f1e4000c370 msgr2=0x7f1e400d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.234+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 shutdown_connections 2024-01-27T14:32:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.234+0000 7f1e4ca2e640 1 -- 172.21.15.46:0/121109153 wait complete. 2024-01-27T14:32:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.234+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== osd.2 v2:172.21.15.46:6805/3503918932 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fadc80770a0 con 0x7fadc8074530 2024-01-27T14:32:32.235 INFO:teuthology.orchestra.run.smithi046.stdout:60129542161 2024-01-27T14:32:32.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.236+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fbe38058420 con 0x7fbe40153c70 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.237+0000 7fbe27fff640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7fbe2c0745c0 0x7fbe2c076a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.237+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe2c077130 con 0x7fbe2c0745c0 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.237+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe38054760 con 0x7fbe40153c70 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.237+0000 7fbe3effd640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7fbe2c0745c0 0x7fbe2c076a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.237+0000 7fbe3effd640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7fbe2c0745c0 0x7fbe2c076a60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.238+0000 7ff506ffd640 1 -- 172.21.15.46:0/1377994665 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc030860 con 0x7ff50806f770 2024-01-27T14:32:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.238+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== osd.0 v2:172.21.15.46:6803/4069301079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbe2c077130 con 0x7fbe2c0745c0 2024-01-27T14:32:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.238+0000 7ff506ffd640 1 -- 172.21.15.46:0/1377994665 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0309c0 con 0x7ff50806f770 2024-01-27T14:32:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.238+0000 7ff506ffd640 1 -- 172.21.15.46:0/1377994665 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc030d90 con 0x7ff50806f770 2024-01-27T14:32:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 -- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 msgr2=0x7ff5080c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5080c5340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009870 tx=0x7ff4fc02b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 -- 172.21.15.46:0/1377994665 shutdown_connections 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5080c5340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1377994665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff50815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 -- 172.21.15.46:0/1377994665 >> 172.21.15.46:0/1377994665 conn(0x7ff5080c8140 msgr2=0x7ff5080c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 -- 172.21.15.46:0/1377994665 shutdown_connections 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0fb0014820 con 0x7f0fb8151810 2024-01-27T14:32:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.239+0000 7ff50e60e640 1 -- 172.21.15.46:0/1377994665 wait complete. 2024-01-27T14:32:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.240+0000 7f0faeffd640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0f9806af20 0x7f0f9806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.240+0000 7f0fb659c640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0f9806af20 0x7f0f9806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.241+0000 7ff50e60e640 1 Processor -- start 2024-01-27T14:32:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.241+0000 7f0fb659c640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0f9806af20 0x7f0f9806d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0036000 tx=0x7f0fa0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.241+0000 7ff50e60e640 1 -- start start 2024-01-27T14:32:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff5081e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5081e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.242 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:32.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5080c5880 0x7ff5081e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f63b0 con 0x7ff5080c5880 2024-01-27T14:32:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f54c0 con 0x7ff50806f770 2024-01-27T14:32:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.242+0000 7ff50e60e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f57a0 con 0x7ff50806f390 2024-01-27T14:32:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.243+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5081e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.243+0000 7ff50cbab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5080c5880 0x7ff5081e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-27T14:32:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.243+0000 7ff5077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5081e3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56660/0 (socket says 172.21.15.46:56660) 2024-01-27T14:32:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.243+0000 7ff5077fe640 1 -- 172.21.15.46:0/1664778973 learned_addr learned my addr 172.21.15.46:0/1664778973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0fb0059b30 con 0x7f0fb8151810 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faeffd640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f0f98074490 0x7f0f98076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f98077000 con 0x7f0f98074490 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faffff640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f0f98074490 0x7f0f98076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb0055770 con 0x7f0fb8151810 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.245+0000 7f0faffff640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f0f98074490 0x7f0f98076930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.246+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== osd.6 v2:172.21.15.73:6800/71356255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f98077000 con 0x7f0f98074490 2024-01-27T14:32:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.247+0000 7ff5077fe640 1 -- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 msgr2=0x7ff5081e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.247+0000 7ff5077fe640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff50806f390 0x7ff5081e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.247+0000 7ff5077fe640 1 -- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5080c5880 msgr2=0x7ff5081e42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.247+0000 7ff5077fe640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5080c5880 0x7ff5081e42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.247+0000 7ff5077fe640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0094d0 con 0x7ff50806f770 2024-01-27T14:32:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:32.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-27T14:32:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.249+0000 7ff5077fe640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5081e3d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc02b9e0 tx=0x7ff4fc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.253+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc039a90 con 0x7ff50806f770 2024-01-27T14:32:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.253+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc039c10 con 0x7ff50806f770 2024-01-27T14:32:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.253+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc043410 con 0x7ff50806f770 2024-01-27T14:32:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.253+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5081f5a80 con 0x7ff50806f770 2024-01-27T14:32:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.253+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5081f6040 con 0x7ff50806f770 2024-01-27T14:32:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.254+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5080c4e20 con 0x7ff50806f770 2024-01-27T14:32:32.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.263+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 --> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faddc047530 con 0x7fadc8074530 2024-01-27T14:32:32.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.263+0000 7fadda7fc640 1 -- 172.21.15.46:0/3688259795 <== osd.2 v2:172.21.15.46:6805/3503918932 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fadd40011b0 con 0x7fadc8074530 2024-01-27T14:32:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7fadc8074530 msgr2=0x7fadc80769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7fadc8074530 0x7fadc80769d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fadc806aed0 msgr2=0x7fadc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fadc806aed0 0x7fadc806d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fade0009670 tx=0x7fade0006bf0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 msgr2=0x7faddc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 --2- 172.21.15.46:0/3688259795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faddc0d5e40 0x7faddc0cbc50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fade404ef70 tx=0x7fade4069320 comp rx=0 tx=0).stop 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea014640 1 -- 172.21.15.46:0/3688259795 reap_dead start 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 shutdown_connections 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.264+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 >> 172.21.15.46:0/3688259795 conn(0x7faddc051310 msgr2=0x7faddc0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.265+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 shutdown_connections 2024-01-27T14:32:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.265+0000 7fadea815640 1 -- 172.21.15.46:0/3688259795 wait complete. 2024-01-27T14:32:32.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.265+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 --> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe20002cb0 con 0x7fbe2c0745c0 2024-01-27T14:32:32.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe27fff640 1 -- 172.21.15.46:0/2488991302 <== osd.0 v2:172.21.15.46:6803/4069301079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe20002cb0 con 0x7fbe2c0745c0 2024-01-27T14:32:32.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7fbe2c0745c0 msgr2=0x7fbe2c076a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7fbe2c0745c0 0x7fbe2c076a60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbe2c06af60 msgr2=0x7fbe2c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbe2c06af60 0x7fbe2c06d420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe34000f60 tx=0x7fbe340079d0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 msgr2=0x7fbe401346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe45c90640 1 --2- 172.21.15.46:0/2488991302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe40153c70 0x7fbe401346b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800caa0 tx=0x7fbe3800cf60 comp rx=0 tx=0).stop 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.266+0000 7fbe3ffff640 1 -- 172.21.15.46:0/2488991302 reap_dead start 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.267+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 shutdown_connections 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.267+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 >> 172.21.15.46:0/2488991302 conn(0x7fbe400cbf80 msgr2=0x7fbe401543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.267+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 shutdown_connections 2024-01-27T14:32:32.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.267+0000 7fbe45c90640 1 -- 172.21.15.46:0/2488991302 wait complete. 2024-01-27T14:32:32.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.277+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 --> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fb8158220 con 0x7f0f98074490 2024-01-27T14:32:32.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.278+0000 7f0faeffd640 1 -- 172.21.15.46:0/523697986 <== osd.6 v2:172.21.15.73:6800/71356255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fa80012e0 con 0x7f0f98074490 2024-01-27T14:32:32.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.278+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff4fc04c3b0 con 0x7ff50806f770 2024-01-27T14:32:32.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff504ff9640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4f406af50 0x7ff4f406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff4fc0ac500 con 0x7ff50806f770 2024-01-27T14:32:32.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff504ff9640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7ff4f40746b0 0x7ff4f4076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4f4077220 con 0x7ff4f40746b0 2024-01-27T14:32:32.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff507fff640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4f406af50 0x7ff4f406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f0f98074490 msgr2=0x7f0f98076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f0f98074490 0x7f0f98076930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.279+0000 7ff50cbab640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7ff4f40746b0 0x7ff4f4076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7ff50cbab640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7ff4f40746b0 0x7ff4f4076b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0f9806af20 msgr2=0x7f0f9806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0f9806af20 0x7f0f9806d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0036000 tx=0x7f0fa0030000 comp rx=0 tx=0).stop 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 msgr2=0x7f0fb8147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 --2- 172.21.15.46:0/523697986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fb8151810 0x7f0fb8147b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000efc0 tx=0x7f0fb000c490 comp rx=0 tx=0).stop 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fb6d9d640 1 -- 172.21.15.46:0/523697986 reap_dead start 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 shutdown_connections 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 >> 172.21.15.46:0/523697986 conn(0x7f0fb8066c80 msgr2=0x7f0fb806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.280+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 shutdown_connections 2024-01-27T14:32:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.281+0000 7f0fbcf78640 1 -- 172.21.15.46:0/523697986 wait complete. 2024-01-27T14:32:32.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.281+0000 7ff507fff640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4f406af50 0x7ff4f406d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006fd0 tx=0x7ff4f8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.281+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== osd.5 v2:172.21.15.73:6816/276149811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff4f4077220 con 0x7ff4f40746b0 2024-01-27T14:32:32.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.281+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4fc077190 con 0x7ff50806f770 2024-01-27T14:32:32.280 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:32.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-27T14:32:32.282 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:32.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-27T14:32:32.293 INFO:teuthology.orchestra.run.smithi046.stdout:60129542160 2024-01-27T14:32:32.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-27T14:32:32.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.303+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 --> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5080c4b40 con 0x7ff4f40746b0 2024-01-27T14:32:32.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.304+0000 7ff504ff9640 1 -- 172.21.15.46:0/1664778973 <== osd.5 v2:172.21.15.73:6816/276149811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff500001b30 con 0x7ff4f40746b0 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7ff4f40746b0 msgr2=0x7ff4f4076b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7ff4f40746b0 0x7ff4f4076b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4f406af50 msgr2=0x7ff4f406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff4f406af50 0x7ff4f406d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006fd0 tx=0x7ff4f8008040 comp rx=0 tx=0).stop 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 msgr2=0x7ff5081e3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 --2- 172.21.15.46:0/1664778973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff50806f770 0x7ff5081e3d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc02b9e0 tx=0x7ff4fc004730 comp rx=0 tx=0).stop 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50cbab640 1 -- 172.21.15.46:0/1664778973 reap_dead start 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 shutdown_connections 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 >> 172.21.15.46:0/1664778973 conn(0x7ff5080c8140 msgr2=0x7ff5080c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 shutdown_connections 2024-01-27T14:32:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.305+0000 7ff50e60e640 1 -- 172.21.15.46:0/1664778973 wait complete. 2024-01-27T14:32:32.323 INFO:teuthology.orchestra.run.smithi046.stdout:64424509456 2024-01-27T14:32:32.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-27T14:32:32.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.397+0000 7f03cddac640 1 Processor -- start 2024-01-27T14:32:32.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.397+0000 7f03cddac640 1 -- start start 2024-01-27T14:32:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.400+0000 7f03ccdaa640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f03c00d5200 0x7f03c004b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57390/0 (socket says 172.21.15.46:57390) 2024-01-27T14:32:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.400+0000 7f03ccdaa640 1 -- 172.21.15.46:0/3064956220 learned_addr learned my addr 172.21.15.46:0/3064956220 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.401+0000 7f03cddac640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00db210 0x7f03c0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.402+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c0008130 con 0x7f03c00d5200 2024-01-27T14:32:32.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.403+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c0007240 con 0x7f03c0006270 2024-01-27T14:32:32.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.404+0000 7f03c7fff640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00db210 0x7f03c0006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.404+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0047c50 con 0x7f03c00db210 2024-01-27T14:32:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.406+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361083368 0 0) 0x7f03c0008130 con 0x7f03c00d5200 2024-01-27T14:32:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.406+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b8003520 con 0x7f03c00d5200 2024-01-27T14:32:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.407+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988816315 0 0) 0x7f03c0007240 con 0x7f03c0006270 2024-01-27T14:32:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.407+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c0008130 con 0x7f03c0006270 2024-01-27T14:32:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2936542234 0 0) 0x7f03b8003520 con 0x7f03c00d5200 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00db210 msgr2=0x7f03c0006b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00db210 0x7f03c0006b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 >> v1:172.21.15.73:6789/0 conn(0x7f03c0006270 legacy=0x7f03c00dc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0007520 con 0x7f03c00d5200 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f03bc001670 con 0x7f03c00d5200 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 >> v1:172.21.15.46:6789/0 conn(0x7f03c00d5200 legacy=0x7f03c004b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.413+0000 7f03c77fe640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03b8003b30 0x7f03b8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.414+0000 7f03c77fe640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b80047c0 0x7f03b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.414+0000 7f03c77fe640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03b8005180 0x7f03b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.414+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0047c50 con 0x7f03b80047c0 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.414+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b800bfa0 con 0x7f03b8003b30 2024-01-27T14:32:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.414+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b800c160 con 0x7f03b8005180 2024-01-27T14:32:32.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.416+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03b8005180 0x7f03b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.416+0000 7f03c7fff640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00db210 0x7f03c0006b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:32.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.418+0000 7f03ccdaa640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03b8003b30 0x7f03b8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.420+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03b8003b30 msgr2=0x7f03b8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.420+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03b8003b30 0x7f03b8003f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.420+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3064956220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b80047c0 msgr2=0x7f03b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.420+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b80047c0 0x7f03b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.420+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3064956220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8003520 con 0x7f03b8005180 2024-01-27T14:32:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.423+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03b8005180 0x7f03b800b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03c8068850 tx=0x7f03b80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=618867707e5e244f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.424+0000 7fdf00f9e640 1 Processor -- start 2024-01-27T14:32:32.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.424+0000 7fdf00f9e640 1 -- start start 2024-01-27T14:32:32.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7f761f51d640 1 Processor -- start 2024-01-27T14:32:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7fdf00f9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdef4045720 0x7fdef4045b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7fdf00f9e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef4007af0 con 0x7fdef40de3b0 2024-01-27T14:32:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7fdf00f9e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef4046090 con 0x7fdef40d5090 2024-01-27T14:32:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7fdf00f9e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef404bf20 con 0x7fdef4045720 2024-01-27T14:32:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.425+0000 7f761f51d640 1 -- start start 2024-01-27T14:32:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.426+0000 7fdefb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdef40d5090 0x7fdef404b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:37142/0 (socket says 172.21.15.46:37142) 2024-01-27T14:32:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.426+0000 7fdefb7fe640 1 -- 172.21.15.46:0/4169212920 learned_addr learned my addr 172.21.15.46:0/4169212920 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f761f51d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76100dd430 0x7f76100e3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f761f51d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7610050540 0x7f761004a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f761f51d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761004a550 con 0x7f761004f420 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f761f51d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100554d0 con 0x7f7610050540 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f761f51d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100e3750 con 0x7f76100dd430 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80ad600 con 0x7f03b8005180 2024-01-27T14:32:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c80a9050 con 0x7f03b8005180 2024-01-27T14:32:32.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7f03c77fe640 1 -- 172.21.15.46:0/3064956220 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80ada60 con 0x7f03b8005180 2024-01-27T14:32:32.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.427+0000 7fdefaffd640 1 --2- 172.21.15.46:0/4169212920 >> v2:172.21.15.73:3300/0 conn(0x7fdef4045720 0x7fdef4045b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03b8005180 msgr2=0x7f03b800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f761cab8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7610050540 0x7f761004a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f03cddac640 1 --2- 172.21.15.46:0/3064956220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03b8005180 0x7f03b800b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03c8068850 tx=0x7f03b80057f0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3064956220 reap_dead start 2024-01-27T14:32:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 shutdown_connections 2024-01-27T14:32:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.428+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 >> 172.21.15.46:0/3064956220 conn(0x7f03c004d4b0 msgr2=0x7f03c004d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.429+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 shutdown_connections 2024-01-27T14:32:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.429+0000 7f761cab8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7610050540 0x7f761004a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53122/0 (socket says 172.21.15.46:53122) 2024-01-27T14:32:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.429+0000 7f761cab8640 1 -- 172.21.15.46:0/3310882041 learned_addr learned my addr 172.21.15.46:0/3310882041 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.429+0000 7f03cddac640 1 -- 172.21.15.46:0/3064956220 wait complete. 2024-01-27T14:32:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.429+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092926144 0 0) 0x7fdef4046090 con 0x7fdef40d5090 2024-01-27T14:32:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.430+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeec003440 con 0x7fdef40d5090 2024-01-27T14:32:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.430+0000 7f03cddac640 1 Processor -- start 2024-01-27T14:32:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.430+0000 7f03cddac640 1 -- start start 2024-01-27T14:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.431+0000 7fc66e761640 1 Processor -- start 2024-01-27T14:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.431+0000 7fc66e761640 1 -- start start 2024-01-27T14:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.431+0000 7f03cddac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8005180 0x7f03c00d85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7f03cddac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03c0033450 0x7f03c0036180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7f03cddac640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7f03cddac640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00d8140 con 0x7f03b8005180 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7f03cddac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0034c90 con 0x7f03c0033450 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462400515 0 0) 0x7fdef4007af0 con 0x7fdef40de3b0 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeec003930 con 0x7fdef40de3b0 2024-01-27T14:32:32.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7f03cddac640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0034f70 con 0x7f03c00d7430 2024-01-27T14:32:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fc66e761640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc6680b0cd0 0x7fc66806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fc66e761640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6680c5900 0x7fc6680c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fc66e761640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680c2120 con 0x7fc668157e30 2024-01-27T14:32:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fc66e761640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680c1880 con 0x7fc6680b0cd0 2024-01-27T14:32:32.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.432+0000 7fc66e761640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680c1b60 con 0x7fc6680c5900 2024-01-27T14:32:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.433+0000 7f03cd5ab640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.433+0000 7f03cd5ab640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47646/0 (socket says 172.21.15.46:47646) 2024-01-27T14:32:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.433+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3946073976 learned_addr learned my addr 172.21.15.46:0/3946073976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7f761d2b9640 1 --2- 172.21.15.46:0/3310882041 >> v2:172.21.15.73:3300/0 conn(0x7f76100dd430 0x7f76100e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212126713 0 0) 0x7fdeec003440 con 0x7fdef40d5090 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 >> v2:172.21.15.73:3300/0 conn(0x7fdef4045720 msgr2=0x7fdef4045b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 --2- 172.21.15.46:0/4169212920 >> v2:172.21.15.73:3300/0 conn(0x7fdef4045720 0x7fdef4045b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 >> v1:172.21.15.46:6789/0 conn(0x7fdef40de3b0 legacy=0x7fdef40de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7f761cab8640 1 -- 172.21.15.46:0/3310882041 >> v2:172.21.15.73:3300/0 conn(0x7f76100dd430 msgr2=0x7f76100e3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7f761cab8640 1 --2- 172.21.15.46:0/3310882041 >> v2:172.21.15.73:3300/0 conn(0x7f76100dd430 0x7f76100e3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7f761cab8640 1 -- 172.21.15.46:0/3310882041 >> v1:172.21.15.73:6789/0 conn(0x7f761004f420 legacy=0x7f76100e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7f761cab8640 1 -- 172.21.15.46:0/3310882041 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761004a220 con 0x7f7610050540 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4006ee0 con 0x7fdef40d5090 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7fdef0004cb0 con 0x7fdef40d5090 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 >> v1:172.21.15.73:6789/0 conn(0x7fdef40d5090 legacy=0x7fdef404b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeec003dc0 0x7fdeec00ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdeec00d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeec00dac0 0x7fdeec00feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef404bf20 con 0x7fdeec00dac0 2024-01-27T14:32:32.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0106c0 con 0x7fdeec003dc0 2024-01-27T14:32:32.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.435+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec010880 con 0x7fdeec00b190 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.436+0000 7f03c7fff640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03c0033450 0x7f03c0036180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.436+0000 7f03ccdaa640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8005180 0x7f03c00d85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.437+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03c0033450 msgr2=0x7f03c0036180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.437+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03c0033450 0x7f03c0036180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.437+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8005180 msgr2=0x7f03c00d85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.437+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8005180 0x7f03c00d85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.437+0000 7f03cd5ab640 1 -- 172.21.15.46:0/3946073976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0035250 con 0x7f03c00d7430 2024-01-27T14:32:32.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.439+0000 7fdefaffd640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdeec00d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.440+0000 7f03cd5ab640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03c804fcc0 tx=0x7f03c8069320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.441+0000 7fc66ccfe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6680c5900 0x7fc6680c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.441+0000 7fc667fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc668157e30 0x7fc6681619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57414/0 (socket says 172.21.15.46:57414) 2024-01-27T14:32:32.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.441+0000 7fc667fff640 1 -- 172.21.15.46:0/316974303 learned_addr learned my addr 172.21.15.46:0/316974303 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.443+0000 7fdefaffd640 1 -- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeec003dc0 msgr2=0x7fdeec00ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.443+0000 7fdefaffd640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeec003dc0 0x7fdeec00ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.443+0000 7fdefaffd640 1 -- 172.21.15.46:0/4169212920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeec00dac0 msgr2=0x7fdeec00feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.443+0000 7fdefaffd640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdeec00dac0 0x7fdeec00feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.443+0000 7fdefbfff640 1 -- 172.21.15.46:0/4169212920 reap_dead start 2024-01-27T14:32:32.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.444+0000 7fdefaffd640 1 -- 172.21.15.46:0/4169212920 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4007af0 con 0x7fdeec00b190 2024-01-27T14:32:32.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.444+0000 7f761cab8640 1 --2- 172.21.15.46:0/3310882041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7610050540 0x7f761004a9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7610011d90 tx=0x7f760802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7910450c55ba4f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.447+0000 7fdefaffd640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdeec00d580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0043c0 tx=0x7fdeec0036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea3700f1d98d1a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.447+0000 7fc66ccfe640 1 -- 172.21.15.46:0/316974303 >> v2:172.21.15.46:3300/0 conn(0x7fc6680b0cd0 msgr2=0x7fc66806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.447+0000 7fc66ccfe640 1 --2- 172.21.15.46:0/316974303 >> v2:172.21.15.46:3300/0 conn(0x7fc6680b0cd0 0x7fc66806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.447+0000 7fc66ccfe640 1 -- 172.21.15.46:0/316974303 >> v1:172.21.15.46:6789/0 conn(0x7fc668157e30 legacy=0x7fc6681619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.447+0000 7fc66ccfe640 1 -- 172.21.15.46:0/316974303 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680c1e40 con 0x7fc6680c5900 2024-01-27T14:32:32.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.448+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8062040 con 0x7f03c00d7430 2024-01-27T14:32:32.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.448+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c80b68d0 con 0x7f03c00d7430 2024-01-27T14:32:32.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.448+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80b6c80 con 0x7f03c00d7430 2024-01-27T14:32:32.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.449+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00d9300 con 0x7f03c00d7430 2024-01-27T14:32:32.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.450+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00d78b0 con 0x7f03c00d7430 2024-01-27T14:32:32.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.451+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0005710 con 0x7f03c00d7430 2024-01-27T14:32:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.452+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8033440 con 0x7fdeec00b190 2024-01-27T14:32:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.452+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80335a0 con 0x7fdeec00b190 2024-01-27T14:32:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.452+0000 7fdefa7fc640 1 -- 172.21.15.46:0/4169212920 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8033970 con 0x7fdeec00b190 2024-01-27T14:32:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 -- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 msgr2=0x7fdeec00d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdeec00d580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0043c0 tx=0x7fdeec0036f0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 -- 172.21.15.46:0/4169212920 shutdown_connections 2024-01-27T14:32:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/4169212920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdeec00d580 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 -- 172.21.15.46:0/4169212920 >> 172.21.15.46:0/4169212920 conn(0x7fdef40505d0 msgr2=0x7fdef40509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fdf00f9e640 1 -- 172.21.15.46:0/4169212920 shutdown_connections 2024-01-27T14:32:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.454+0000 7fdf00f9e640 1 -- 172.21.15.46:0/4169212920 wait complete. 2024-01-27T14:32:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.453+0000 7fc66ccfe640 1 --2- 172.21.15.46:0/316974303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680c5900 0x7fc6680c5d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc66806e7b0 tx=0x7fc66002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8458bfefac152a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.455+0000 7fdf00f9e640 1 Processor -- start 2024-01-27T14:32:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.455+0000 7f760ffff640 1 -- 172.21.15.46:0/3310882041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608030860 con 0x7f7610050540 2024-01-27T14:32:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.455+0000 7f760ffff640 1 -- 172.21.15.46:0/3310882041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76080309c0 con 0x7f7610050540 2024-01-27T14:32:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.455+0000 7f760ffff640 1 -- 172.21.15.46:0/3310882041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608030d50 con 0x7f7610050540 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.455+0000 7fdf00f9e640 1 -- start start 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdef4174a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef40d2e90 0x7fdef4171f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4174f70 con 0x7fdef40d2e90 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef41713c0 con 0x7fdef40359f0 2024-01-27T14:32:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7fdf00f9e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40347b0 con 0x7fdeec00b190 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 -- 172.21.15.46:0/3310882041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7610050540 msgr2=0x7f761004a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 --2- 172.21.15.46:0/3310882041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7610050540 0x7f761004a9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7610011d90 tx=0x7f760802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 -- 172.21.15.46:0/3310882041 shutdown_connections 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 --2- 172.21.15.46:0/3310882041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7610050540 0x7f761004a9e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 --2- 172.21.15.46:0/3310882041 >> v2:172.21.15.73:3300/0 conn(0x7f76100dd430 0x7f76100e3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 -- 172.21.15.46:0/3310882041 >> 172.21.15.46:0/3310882041 conn(0x7f7610054580 msgr2=0x7f7610054990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 -- 172.21.15.46:0/3310882041 shutdown_connections 2024-01-27T14:32:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.456+0000 7f761f51d640 1 -- 172.21.15.46:0/3310882041 wait complete. 2024-01-27T14:32:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.458+0000 7fc666ffd640 1 -- 172.21.15.46:0/316974303 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66002cc70 con 0x7fc6680c5900 2024-01-27T14:32:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.458+0000 7fc666ffd640 1 -- 172.21.15.46:0/316974303 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66002cdd0 con 0x7fc6680c5900 2024-01-27T14:32:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.458+0000 7f761f51d640 1 Processor -- start 2024-01-27T14:32:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.458+0000 7fc666ffd640 1 -- 172.21.15.46:0/316974303 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660034660 con 0x7fc6680c5900 2024-01-27T14:32:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.458+0000 7f761f51d640 1 -- start start 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 -- 172.21.15.46:0/316974303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680c5900 msgr2=0x7fc6680c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 --2- 172.21.15.46:0/316974303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680c5900 0x7fc6680c5d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc66806e7b0 tx=0x7fc66002bec0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 -- 172.21.15.46:0/316974303 shutdown_connections 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 --2- 172.21.15.46:0/316974303 >> v2:172.21.15.46:3300/0 conn(0x7fc6680b0cd0 0x7fc66806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 --2- 172.21.15.46:0/316974303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680c5900 0x7fc6680c5d70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 -- 172.21.15.46:0/316974303 >> 172.21.15.46:0/316974303 conn(0x7fc6680c7a00 msgr2=0x7fc6680c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 -- 172.21.15.46:0/316974303 shutdown_connections 2024-01-27T14:32:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fc66e761640 1 -- 172.21.15.46:0/316974303 wait complete. 2024-01-27T14:32:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.459+0000 7fdefbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 0x7f7610178be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7610050540 0x7f76100e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 0x7f761004d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100dff10 con 0x7f761004f420 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761004d020 con 0x7f76100dd430 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7f761f51d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761004d300 con 0x7f7610050540 2024-01-27T14:32:32.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7fdefbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56730/0 (socket says 172.21.15.46:56730) 2024-01-27T14:32:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.460+0000 7fdefbfff640 1 -- 172.21.15.46:0/3541268032 learned_addr learned my addr 172.21.15.46:0/3541268032 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.461+0000 7fc66e761640 1 Processor -- start 2024-01-27T14:32:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.461+0000 7fc66e761640 1 -- start start 2024-01-27T14:32:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6680c5900 0x7fc66814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc668157e30 0x7fc6681525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680ca6b0 con 0x7fc668157e30 2024-01-27T14:32:32.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668149ce0 con 0x7fc6680b0cd0 2024-01-27T14:32:32.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.462+0000 7fc66e761640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc668149fa0 con 0x7fc6680c5900 2024-01-27T14:32:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.464+0000 7fdefbfff640 1 -- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 msgr2=0x7fdef4174a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.464+0000 7fdefbfff640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdef4174a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.464+0000 7fdefbfff640 1 -- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef40d2e90 msgr2=0x7fdef4171f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.464+0000 7fdefbfff640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef40d2e90 0x7fdef4171f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.464+0000 7fdefbfff640 1 -- 172.21.15.46:0/3541268032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4170ab0 con 0x7fdef40359f0 2024-01-27T14:32:32.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.465+0000 7ff3b5ace640 1 Processor -- start 2024-01-27T14:32:32.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.466+0000 7ff3b5ace640 1 -- start start 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7ff3b5ace640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7ff3b5ace640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3b00c8630 0x7ff3b0168590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7ff3b5ace640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00c81a0 con 0x7ff3b00ccc70 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7fc667fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7ff3b5ace640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b00c11a0 con 0x7ff3b00c8630 2024-01-27T14:32:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7ff3b5ace640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b006f5f0 con 0x7ff3b0158150 2024-01-27T14:32:32.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.467+0000 7f761daba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 0x7f761004d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7fdefbfff640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdefc04f800 tx=0x7fdefc000b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7f761daba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 0x7f761004d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56740/0 (socket says 172.21.15.46:56740) 2024-01-27T14:32:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7f761daba640 1 -- 172.21.15.46:0/3926337914 learned_addr learned my addr 172.21.15.46:0/3926337914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7f761d2b9640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 0x7f7610178be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7fc667fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:56750/0 (socket says 172.21.15.46:56750) 2024-01-27T14:32:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.468+0000 7fc667fff640 1 -- 172.21.15.46:0/1696099490 learned_addr learned my addr 172.21.15.46:0/1696099490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.470+0000 7ff3affff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3b00c8630 0x7ff3b0168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.470+0000 7ff3aeffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff3b00ccc70 0x7ff3b00c2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57416/0 (socket says 172.21.15.46:57416) 2024-01-27T14:32:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.470+0000 7ff3aeffd640 1 -- 172.21.15.46:0/2959536574 learned_addr learned my addr 172.21.15.46:0/2959536574 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.471+0000 7f0ebfa77640 1 Processor -- start 2024-01-27T14:32:32.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.471+0000 7f0ebfa77640 1 -- start start 2024-01-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.472+0000 7f0ebfa77640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0eb81504f0 0x7f0eb8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.472+0000 7f0ebfa77640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb80c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.472+0000 7f0ebfa77640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb8157360 con 0x7f0eb80c6580 2024-01-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.472+0000 7f0ebfa77640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80c47a0 con 0x7f0eb81504f0 2024-01-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.472+0000 7f0ebfa77640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8066b50 con 0x7f0eb80c75a0 2024-01-27T14:32:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.473+0000 7fc667fff640 1 -- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6680c5900 msgr2=0x7fc66814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.473+0000 7fc667fff640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6680c5900 0x7fc66814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.473+0000 7fc667fff640 1 -- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc668157e30 msgr2=0x7fc6681525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.473+0000 7fc667fff640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc668157e30 0x7fc6681525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.473+0000 7fc667fff640 1 -- 172.21.15.46:0/1696099490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a70 con 0x7fc6680b0cd0 2024-01-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7fd0d28ec640 1 Processor -- start 2024-01-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7fd0d28ec640 1 -- start start 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7f761d2b9640 1 -- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7610050540 msgr2=0x7f76100e28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7f761d2b9640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7610050540 0x7f76100e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7f761d2b9640 1 -- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 msgr2=0x7f761004d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7f761d2b9640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 0x7f761004d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.474+0000 7f761d2b9640 1 -- 172.21.15.46:0/3926337914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080094d0 con 0x7f761004f420 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.475+0000 7fd0d28ec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.475+0000 7fd0d28ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0cc06ac00 0x7fd0cc0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.475+0000 7fd0d28ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc0c87f0 con 0x7fd0cc151980 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.475+0000 7fd0d28ec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc0c7630 con 0x7fd0cc0cca70 2024-01-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.475+0000 7fd0d28ec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc0c7900 con 0x7fd0cc06ac00 2024-01-27T14:32:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.478+0000 7ff3affff640 1 -- 172.21.15.46:0/2959536574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 msgr2=0x7ff3b0161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.478+0000 7ff3affff640 1 --2- 172.21.15.46:0/2959536574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.478+0000 7ff3affff640 1 -- 172.21.15.46:0/2959536574 >> v1:172.21.15.46:6789/0 conn(0x7ff3b00ccc70 legacy=0x7ff3b00c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.478+0000 7ff3affff640 1 -- 172.21.15.46:0/2959536574 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b006ed90 con 0x7ff3b00c8630 2024-01-27T14:32:32.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc06c480 con 0x7fdef40359f0 2024-01-27T14:32:32.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc08e070 con 0x7fdef40359f0 2024-01-27T14:32:32.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc06a8e0 con 0x7fdef40359f0 2024-01-27T14:32:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7ff3affff640 1 --2- 172.21.15.46:0/2959536574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00c8630 0x7ff3b0168590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009d90 tx=0x7ff3a802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6345ad1c59bb0c2a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef40d3340 con 0x7fdef40359f0 2024-01-27T14:32:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7f761d2b9640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 0x7f7610178be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7618069fd0 tx=0x7f761806cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.483+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef4170d70 con 0x7fdef40359f0 2024-01-27T14:32:32.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.484+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4005710 con 0x7fdef40359f0 2024-01-27T14:32:32.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.485+0000 7fc667fff640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c3c0 tx=0x7fc65800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.487+0000 7f0ebe014640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0eb80c6580 0x7f0eb80c30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57426/0 (socket says 172.21.15.46:57426) 2024-01-27T14:32:32.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.487+0000 7f0ebe014640 1 -- 172.21.15.46:0/2446293065 learned_addr learned my addr 172.21.15.46:0/2446293065 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:32.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.488+0000 7fd0cb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.489+0000 7fd0cb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53192/0 (socket says 172.21.15.46:53192) 2024-01-27T14:32:32.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.489+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/1401375001 learned_addr learned my addr 172.21.15.46:0/1401375001 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.493+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/1401375001 >> v2:172.21.15.73:3300/0 conn(0x7fd0cc06ac00 msgr2=0x7fd0cc0c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.493+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/1401375001 >> v2:172.21.15.73:3300/0 conn(0x7fd0cc06ac00 0x7fd0cc0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.493+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/1401375001 >> v1:172.21.15.73:6789/0 conn(0x7fd0cc151980 legacy=0x7fd0cc1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.493+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/1401375001 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc0c7be0 con 0x7fd0cc0cca70 2024-01-27T14:32:32.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.499+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/1401375001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0c6620 tx=0x7fd0c002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861c2e8daffa3282 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.500+0000 7ff3ae7fc640 1 -- 172.21.15.46:0/2959536574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a802cc50 con 0x7ff3b00c8630 2024-01-27T14:32:32.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.500+0000 7ff3ae7fc640 1 -- 172.21.15.46:0/2959536574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a802cdb0 con 0x7ff3b00c8630 2024-01-27T14:32:32.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.500+0000 7ff3ae7fc640 1 -- 172.21.15.46:0/2959536574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8034660 con 0x7ff3b00c8630 2024-01-27T14:32:32.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76180683e0 con 0x7f761004f420 2024-01-27T14:32:32.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618072050 con 0x7f761004f420 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2959536574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00c8630 msgr2=0x7ff3b0168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2959536574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00c8630 0x7ff3b0168590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009d90 tx=0x7ff3a802bea0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2959536574 shutdown_connections 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2959536574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00c8630 0x7ff3b0168590 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2959536574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2959536574 >> 172.21.15.46:0/2959536574 conn(0x7ff3b00cbf80 msgr2=0x7ff3b00cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618074400 con 0x7f761004f420 2024-01-27T14:32:32.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100e3560 con 0x7f761004f420 2024-01-27T14:32:32.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.501+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2959536574 shutdown_connections 2024-01-27T14:32:32.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.502+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2959536574 wait complete. 2024-01-27T14:32:32.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.502+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761017c900 con 0x7f761004f420 2024-01-27T14:32:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.503+0000 7ff3b5ace640 1 Processor -- start 2024-01-27T14:32:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.503+0000 7ff3b5ace640 1 -- start start 2024-01-27T14:32:32.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610005710 con 0x7f761004f420 2024-01-27T14:32:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00c8630 0x7ff3b00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 0x7ff3b0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cb1d0 con 0x7ff3b00ccc70 2024-01-27T14:32:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00ca850 con 0x7ff3b00c8630 2024-01-27T14:32:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.504+0000 7ff3b5ace640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00caef0 con 0x7ff3b0158150 2024-01-27T14:32:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.507+0000 7fd0caffd640 1 -- 172.21.15.46:0/1401375001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0031890 con 0x7fd0cc0cca70 2024-01-27T14:32:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.507+0000 7fd0caffd640 1 -- 172.21.15.46:0/1401375001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00319f0 con 0x7fd0cc0cca70 2024-01-27T14:32:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.507+0000 7fd0caffd640 1 -- 172.21.15.46:0/1401375001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0031d80 con 0x7fd0cc0cca70 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 -- 172.21.15.46:0/1401375001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc0cca70 msgr2=0x7fd0cc06a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/1401375001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0c6620 tx=0x7fd0c002b930 comp rx=0 tx=0).stop 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 -- 172.21.15.46:0/1401375001 shutdown_connections 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/1401375001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc06a6c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/1401375001 >> v2:172.21.15.73:3300/0 conn(0x7fd0cc06ac00 0x7fd0cc0c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 -- 172.21.15.46:0/1401375001 >> 172.21.15.46:0/1401375001 conn(0x7fd0cc0cbf80 msgr2=0x7fd0cc0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 -- 172.21.15.46:0/1401375001 shutdown_connections 2024-01-27T14:32:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.508+0000 7fd0d28ec640 1 -- 172.21.15.46:0/1401375001 wait complete. 2024-01-27T14:32:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.509+0000 7fd0d28ec640 1 Processor -- start 2024-01-27T14:32:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.509+0000 7fd0d28ec640 1 -- start start 2024-01-27T14:32:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 0x7fd0cc157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0cc151980 0x7fd0cc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc14f530 con 0x7fd0cc06ac00 2024-01-27T14:32:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc153900 con 0x7fd0cc0cca70 2024-01-27T14:32:32.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.510+0000 7fd0d28ec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc14fe10 con 0x7fd0cc151980 2024-01-27T14:32:32.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.518+0000 7f0ebc811640 1 -- 172.21.15.46:0/2446293065 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159732968 0 0) 0x7f0eb8157360 con 0x7f0eb80c6580 2024-01-27T14:32:32.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.518+0000 7f0ebc811640 1 -- 172.21.15.46:0/2446293065 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4003520 con 0x7f0eb80c6580 2024-01-27T14:32:32.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.523+0000 7f2232733640 1 Processor -- start 2024-01-27T14:32:32.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.523+0000 7f2232733640 1 -- start start 2024-01-27T14:32:32.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f222c150970 0x7f222c0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f222c156580 0x7f222c06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c0c1e80 con 0x7f222c150970 2024-01-27T14:32:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c150d50 con 0x7f222c156580 2024-01-27T14:32:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.524+0000 7f2232733640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0c0fa0 con 0x7f222c0c8630 2024-01-27T14:32:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.532+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 0x7fd0cc157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.533+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7618093440 con 0x7f761004f420 2024-01-27T14:32:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.534+0000 7f760dffb640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.534+0000 7f761cab8640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.534+0000 7f761cab8640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 0x7f75fc06d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7608036000 tx=0x7f760803b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.536+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 0x7ff3b0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.537+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 0x7fd0cc157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53212/0 (socket says 172.21.15.46:53212) 2024-01-27T14:32:32.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.537+0000 7fd0cbfff640 1 -- 172.21.15.46:0/695356976 learned_addr learned my addr 172.21.15.46:0/695356976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.537+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 0x7ff3b0156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53206/0 (socket says 172.21.15.46:53206) 2024-01-27T14:32:32.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.537+0000 7ff3aeffd640 1 -- 172.21.15.46:0/2380242220 learned_addr learned my addr 172.21.15.46:0/2380242220 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.720+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f03c80b4040 con 0x7f03c00d7430 2024-01-27T14:32:32.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.720+0000 7f03c57fa640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 0x7f03ac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.720+0000 7f03ccdaa640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 0x7f03ac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.721+0000 7f03ccdaa640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 0x7f03ac06d410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.725+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f03c80f53a0 con 0x7f03c00d7430 2024-01-27T14:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.737+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f03c80f0f50 con 0x7f03c00d7430 2024-01-27T14:32:32.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.739+0000 7f0ebd012640 1 --2- 172.21.15.46:0/2446293065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb80c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.740+0000 7ff3affff640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.746+0000 7f0ebd012640 1 -- 172.21.15.46:0/2446293065 >> v2:172.21.15.73:3300/0 conn(0x7f0eb81504f0 msgr2=0x7f0eb8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.746+0000 7f0ebd012640 1 --2- 172.21.15.46:0/2446293065 >> v2:172.21.15.73:3300/0 conn(0x7f0eb81504f0 0x7f0eb8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.746+0000 7f0ebd012640 1 -- 172.21.15.46:0/2446293065 >> v1:172.21.15.46:6789/0 conn(0x7f0eb80c6580 legacy=0x7f0eb80c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.746+0000 7f0ebd012640 1 -- 172.21.15.46:0/2446293065 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80668b0 con 0x7f0eb80c75a0 2024-01-27T14:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.748+0000 7ff3affff640 1 -- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00c8630 msgr2=0x7ff3b00cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.748+0000 7ff3affff640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00c8630 0x7ff3b00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.748+0000 7ff3affff640 1 -- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 msgr2=0x7ff3b0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.748+0000 7ff3affff640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 0x7ff3b0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.748+0000 7ff3affff640 1 -- 172.21.15.46:0/2380242220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8009a70 con 0x7ff3b0158150 2024-01-27T14:32:32.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.749+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdefc06aa40 con 0x7fdef40359f0 2024-01-27T14:32:32.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.750+0000 7fdee7fff640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 0x7fdee006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.750+0000 7fdefb7fe640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 0x7fdee006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.750+0000 7fdefb7fe640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 0x7fdee006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000c00 tx=0x7fdef0004b20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.752+0000 7f222b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.753+0000 7f0ebd012640 1 --2- 172.21.15.46:0/2446293065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb80c6040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097a0 tx=0x7f0ea802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f5c447387b3e9d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.754+0000 7f222b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47720/0 (socket says 172.21.15.46:47720) 2024-01-27T14:32:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.754+0000 7f222b7fe640 1 -- 172.21.15.46:0/306532284 learned_addr learned my addr 172.21.15.46:0/306532284 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.754+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fdefc0d2bc0 con 0x7fdef40359f0 2024-01-27T14:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.755+0000 7ff3affff640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8033000 tx=0x7ff3a8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7f222b7fe640 1 -- 172.21.15.46:0/306532284 >> v2:172.21.15.73:3300/0 conn(0x7f222c156580 msgr2=0x7f222c06d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7f222b7fe640 1 --2- 172.21.15.46:0/306532284 >> v2:172.21.15.73:3300/0 conn(0x7f222c156580 0x7f222c06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7f222b7fe640 1 -- 172.21.15.46:0/306532284 >> v2:172.21.15.46:3300/0 conn(0x7f222c150970 msgr2=0x7f222c0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7f222b7fe640 1 --2- 172.21.15.46:0/306532284 >> v2:172.21.15.46:3300/0 conn(0x7f222c150970 0x7f222c0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7f222b7fe640 1 -- 172.21.15.46:0/306532284 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0c1200 con 0x7f222c0c8630 2024-01-27T14:32:32.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.761+0000 7fd0d0e89640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0cc151980 0x7fd0cc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.766+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdefc0ce800 con 0x7fdef40359f0 2024-01-27T14:32:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.767+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8040650 con 0x7ff3b0158150 2024-01-27T14:32:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.767+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a80407d0 con 0x7ff3b0158150 2024-01-27T14:32:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.767+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8040b80 con 0x7ff3b0158150 2024-01-27T14:32:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.767+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b00c9f20 con 0x7ff3b0158150 2024-01-27T14:32:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.767+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b00ca4e0 con 0x7ff3b0158150 2024-01-27T14:32:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.768+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b00ca670 con 0x7ff3b0158150 2024-01-27T14:32:32.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.768+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.775+0000 7f222b7fe640 1 --2- 172.21.15.46:0/306532284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f222c0c7ac0 tx=0x7f222002e170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ced0106e409a2e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.777+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0cc151980 msgr2=0x7fd0cc152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.777+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0cc151980 0x7fd0cc152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.778+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 msgr2=0x7fd0cc157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.778+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 0x7fd0cc157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.778+0000 7fd0cb7fe640 1 -- 172.21.15.46:0/695356976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00094d0 con 0x7fd0cc0cca70 2024-01-27T14:32:32.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.782+0000 7fd0cb7fe640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc156880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0033000 tx=0x7fd0c00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658005ce0 con 0x7fc6680b0cd0 2024-01-27T14:32:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658005e40 con 0x7fc6680b0cd0 2024-01-27T14:32:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680ca900 con 0x7fc6680b0cd0 2024-01-27T14:32:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6580072f0 con 0x7fc6680b0cd0 2024-01-27T14:32:32.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc668160da0 con 0x7fc6680b0cd0 2024-01-27T14:32:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.788+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00443f0 con 0x7fd0cc0cca70 2024-01-27T14:32:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.789+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0044570 con 0x7fd0cc0cca70 2024-01-27T14:32:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.789+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0044920 con 0x7fd0cc0cca70 2024-01-27T14:32:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.789+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc154360 con 0x7fd0cc0cca70 2024-01-27T14:32:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.789+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc154920 con 0x7fd0cc0cca70 2024-01-27T14:32:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.789+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66806def0 con 0x7fc6680b0cd0 2024-01-27T14:32:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.790+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc0742e0 con 0x7fd0cc0cca70 2024-01-27T14:32:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.800+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff3a8040ce0 con 0x7ff3b0158150 2024-01-27T14:32:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.801+0000 7ff397fff640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 0x7ff39c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.801+0000 7ff3af7fe640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 0x7ff39c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.801+0000 7ff3af7fe640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 0x7ff39c06d410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009670 tx=0x7ff3a0006bf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.805+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff3a807bb40 con 0x7ff3b0158150 2024-01-27T14:32:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.808+0000 7f0ebc811640 1 -- 172.21.15.46:0/2446293065 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8030610 con 0x7f0eb80c75a0 2024-01-27T14:32:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.808+0000 7f0ebc811640 1 -- 172.21.15.46:0/2446293065 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea8030770 con 0x7f0eb80c75a0 2024-01-27T14:32:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.808+0000 7f0ebc811640 1 -- 172.21.15.46:0/2446293065 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8030b00 con 0x7f0eb80c75a0 2024-01-27T14:32:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 -- 172.21.15.46:0/2446293065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 msgr2=0x7f0eb80c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/2446293065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb80c6040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097a0 tx=0x7f0ea802b960 comp rx=0 tx=0).stop 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 -- 172.21.15.46:0/2446293065 shutdown_connections 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/2446293065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb80c6040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/2446293065 >> v2:172.21.15.73:3300/0 conn(0x7f0eb81504f0 0x7f0eb8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 -- 172.21.15.46:0/2446293065 >> 172.21.15.46:0/2446293065 conn(0x7f0eb80c8140 msgr2=0x7f0eb80c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 -- 172.21.15.46:0/2446293065 shutdown_connections 2024-01-27T14:32:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.809+0000 7f0ebfa77640 1 -- 172.21.15.46:0/2446293065 wait complete. 2024-01-27T14:32:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.811+0000 7f0ebfa77640 1 Processor -- start 2024-01-27T14:32:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.811+0000 7f0ebfa77640 1 -- start start 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb81ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb81504f0 0x7f0eb814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8146bd0 con 0x7f0eb80c6580 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8158040 con 0x7f0eb81504f0 2024-01-27T14:32:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.812+0000 7f0ebfa77640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8158570 con 0x7f0eb80c75a0 2024-01-27T14:32:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.818+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc658007510 con 0x7fc6680b0cd0 2024-01-27T14:32:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.819+0000 7fc664ff9640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 0x7fc65406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.819+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f76180d35c0 con 0x7f761004f420 2024-01-27T14:32:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.819+0000 7fc6677fe640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 0x7fc65406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.819+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f76180cf200 con 0x7f761004f420 2024-01-27T14:32:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.819+0000 7fc6677fe640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 0x7fc65406d3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc6681533e0 tx=0x7fc65c006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.825+0000 7f0ebd813640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.826+0000 7f0ebd813640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53230/0 (socket says 172.21.15.46:53230) 2024-01-27T14:32:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.826+0000 7f0ebd813640 1 -- 172.21.15.46:0/14489380 learned_addr learned my addr 172.21.15.46:0/14489380 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.837+0000 7f0ebd813640 1 -- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 msgr2=0x7f0eb81ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.837+0000 7f0ebd813640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb81ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.837+0000 7f0ebd813640 1 -- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb81504f0 msgr2=0x7f0eb814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.837+0000 7f0ebd813640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb81504f0 0x7f0eb814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.837+0000 7f0ebd813640 1 -- 172.21.15.46:0/14489380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8009400 con 0x7f0eb80c6580 2024-01-27T14:32:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.840+0000 7f0ebd813640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b410 tx=0x7f0eb400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.845+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011830 con 0x7f0eb80c6580 2024-01-27T14:32:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.845+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb40119b0 con 0x7f0eb80c6580 2024-01-27T14:32:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.845+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb8158290 con 0x7f0eb80c6580 2024-01-27T14:32:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.845+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011d60 con 0x7f0eb80c6580 2024-01-27T14:32:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.845+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb8157970 con 0x7f0eb80c6580 2024-01-27T14:32:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.846+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb80742e0 con 0x7f0eb80c6580 2024-01-27T14:32:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.930+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f03c00350b0 con 0x7f03c00d7430 2024-01-27T14:32:32.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:32.956+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdef4171500 con 0x7fdef40359f0 2024-01-27T14:32:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.016+0000 7f222affd640 1 -- 172.21.15.46:0/306532284 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220036440 con 0x7f222c0c8630 2024-01-27T14:32:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.016+0000 7f222affd640 1 -- 172.21.15.46:0/306532284 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22200365a0 con 0x7f222c0c8630 2024-01-27T14:32:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7610037ef0 con 0x7f761004f420 2024-01-27T14:32:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 -- 172.21.15.46:0/306532284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 msgr2=0x7f222c0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 --2- 172.21.15.46:0/306532284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f222c0c7ac0 tx=0x7f222002e170 comp rx=0 tx=0).stop 2024-01-27T14:32:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 -- 172.21.15.46:0/306532284 shutdown_connections 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 --2- 172.21.15.46:0/306532284 >> v2:172.21.15.73:3300/0 conn(0x7f222c156580 0x7f222c06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 --2- 172.21.15.46:0/306532284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c0c8630 0x7f222c0c7580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 --2- 172.21.15.46:0/306532284 >> v2:172.21.15.46:3300/0 conn(0x7f222c150970 0x7f222c0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 -- 172.21.15.46:0/306532284 >> 172.21.15.46:0/306532284 conn(0x7f222c0cbf80 msgr2=0x7f222c0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 -- 172.21.15.46:0/306532284 shutdown_connections 2024-01-27T14:32:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.017+0000 7f2232733640 1 -- 172.21.15.46:0/306532284 wait complete. 2024-01-27T14:32:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.018+0000 7f2232733640 1 Processor -- start 2024-01-27T14:32:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 -- start start 2024-01-27T14:32:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f222c0c8630 0x7f222c14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f222c156580 0x7f222c1466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0caef0 con 0x7f222c156580 2024-01-27T14:32:33.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c14f5e0 con 0x7f222c0c8630 2024-01-27T14:32:33.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.019+0000 7f2232733640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0ca6a0 con 0x7f222c150970 2024-01-27T14:32:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.064+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc658058320 con 0x7fc6680b0cd0 2024-01-27T14:32:33.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.066+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff3a8077780 con 0x7ff3b0158150 2024-01-27T14:32:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.076+0000 7f222b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.078+0000 7f222b7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47732/0 (socket says 172.21.15.46:47732) 2024-01-27T14:32:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.078+0000 7f222b7fe640 1 -- 172.21.15.46:0/1511374907 learned_addr learned my addr 172.21.15.46:0/1511374907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.083+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc658053f60 con 0x7fc6680b0cd0 2024-01-27T14:32:33.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.097+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd0c004d450 con 0x7fd0cc0cca70 2024-01-27T14:32:33.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.097+0000 7fd0c8ff9640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 0x7fd0b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.097+0000 7fd0cbfff640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 0x7fd0b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:33.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.098+0000 7fd0cbfff640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 0x7fd0b806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0099a0 tx=0x7fd0bc0090e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.100+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd0c007add0 con 0x7fd0cc0cca70 2024-01-27T14:32:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.101+0000 7fdee7fff640 1 -- 172.21.15.46:0/3541268032 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdefc099070 con 0x7fdef40359f0 2024-01-27T14:32:33.099 INFO:teuthology.orchestra.run.smithi046.stdout:60129542160 2024-01-27T14:32:33.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.102+0000 7f222bfff640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f222c0c8630 0x7f222c14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:33.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 msgr2=0x7fdee006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 0x7fdee006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000c00 tx=0x7fdef0004b20 comp rx=0 tx=0).stop 2024-01-27T14:32:33.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 msgr2=0x7fdef40c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdefc04f800 tx=0x7fdefc000b00 comp rx=0 tx=0).stop 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 shutdown_connections 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdee006aed0 0x7fdee006d390 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000c00 tx=0x7fdef0004b20 comp rx=0 tx=0).stop 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef40359f0 0x7fdef40c8e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdef40d2e90 0x7fdef4171f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 --2- 172.21.15.46:0/3541268032 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdeec00b190 0x7fdef4174a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 >> 172.21.15.46:0/3541268032 conn(0x7fdef40505d0 msgr2=0x7fdef40d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.103+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 shutdown_connections 2024-01-27T14:32:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.104+0000 7fdf00f9e640 1 -- 172.21.15.46:0/3541268032 wait complete. 2024-01-27T14:32:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.105+0000 7f222b7fe640 1 -- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f222c0c8630 msgr2=0x7f222c14a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.105+0000 7f222b7fe640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f222c0c8630 0x7f222c14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.105+0000 7f222b7fe640 1 -- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f222c156580 msgr2=0x7f222c1466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.105+0000 7f222b7fe640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f222c156580 0x7f222c1466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.105+0000 7f222b7fe640 1 -- 172.21.15.46:0/1511374907 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222000b770 con 0x7f222c150970 2024-01-27T14:32:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.108+0000 7f03c57fa640 1 -- 172.21.15.46:0/3946073976 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03c00350b0 con 0x7f03c00d7430 2024-01-27T14:32:33.104 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.108+0000 7f222b7fe640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222002e1b0 tx=0x7f22200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 msgr2=0x7f03ac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 0x7f03ac06d410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 msgr2=0x7f03c0173e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03c804fcc0 tx=0x7f03c8069320 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 shutdown_connections 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f03ac06af50 0x7f03ac06d410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03c0033450 0x7f03c0036180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03c00d7430 0x7f03c0173e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 --2- 172.21.15.46:0/3946073976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8005180 0x7f03c00d85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 >> 172.21.15.46:0/3946073976 conn(0x7f03c004d4b0 msgr2=0x7f03c00cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 shutdown_connections 2024-01-27T14:32:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.110+0000 7f03cddac640 1 -- 172.21.15.46:0/3946073976 wait complete. 2024-01-27T14:32:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.114+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220036440 con 0x7f222c150970 2024-01-27T14:32:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.114+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220003a40 con 0x7f222c150970 2024-01-27T14:32:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.114+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220003df0 con 0x7f222c150970 2024-01-27T14:32:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.115+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c14ec40 con 0x7f222c150970 2024-01-27T14:32:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.115+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c14f200 con 0x7f222c150970 2024-01-27T14:32:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.116+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c14f720 con 0x7f222c150970 2024-01-27T14:32:33.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542160 for osd.4 2024-01-27T14:32:33.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.7 2024-01-27T14:32:33.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.132+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0eb401a400 con 0x7f0eb80c6580 2024-01-27T14:32:33.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.133+0000 7f0eae7fc640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 0x7f0e9c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.133+0000 7f0ebd012640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 0x7f0e9c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:33.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.133+0000 7f0ebd012640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 0x7f0e9c06d410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097a0 tx=0x7f0ea803b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.140+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2220042450 con 0x7f222c150970 2024-01-27T14:32:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.140+0000 7f2228ff9640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 0x7f221806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.140+0000 7f222bfff640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 0x7f221806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.140+0000 7f222bfff640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 0x7f221806d3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a770 tx=0x7f221c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:33.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.152+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f0eb40590c0 con 0x7f0eb80c6580 2024-01-27T14:32:33.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.152+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0eb4054d00 con 0x7f0eb80c6580 2024-01-27T14:32:33.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.191+0000 7f760dffb640 1 -- 172.21.15.46:0/3926337914 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76180d2820 con 0x7f761004f420 2024-01-27T14:32:33.188 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 msgr2=0x7f75fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 0x7f75fc06d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7608036000 tx=0x7f760803b040 comp rx=0 tx=0).stop 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 msgr2=0x7f7610178be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 0x7f7610178be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7618069fd0 tx=0x7f761806cc20 comp rx=0 tx=0).stop 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 shutdown_connections 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76100dd430 0x7f761004d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7610050540 0x7f76100e28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 --2- 172.21.15.46:0/3926337914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f761004f420 0x7f7610178be0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 >> 172.21.15.46:0/3926337914 conn(0x7f7610054580 msgr2=0x7f7610052b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 shutdown_connections 2024-01-27T14:32:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.194+0000 7f761f51d640 1 -- 172.21.15.46:0/3926337914 wait complete. 2024-01-27T14:32:33.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.3 2024-01-27T14:32:33.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.288+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6680742e0 con 0x7fc6680b0cd0 2024-01-27T14:32:33.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.348+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff3b00742e0 con 0x7ff3b0158150 2024-01-27T14:32:33.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.371+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd0c0077110 con 0x7fd0cc0cca70 2024-01-27T14:32:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.372+0000 7fc664ff9640 1 -- 172.21.15.46:0/1696099490 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc658057580 con 0x7fc6680b0cd0 2024-01-27T14:32:33.369 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 msgr2=0x7fc65406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 0x7fc65406d3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc6681533e0 tx=0x7fc65c006c90 comp rx=0 tx=0).stop 2024-01-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 msgr2=0x7fc668160190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c3c0 tx=0x7fc65800c880 comp rx=0 tx=0).stop 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 shutdown_connections 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc65406af20 0x7fc65406d3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc668157e30 0x7fc6681525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6680c5900 0x7fc66814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 --2- 172.21.15.46:0/1696099490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6680b0cd0 0x7fc668160190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 >> 172.21.15.46:0/1696099490 conn(0x7fc6680c7a00 msgr2=0x7fc668072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 shutdown_connections 2024-01-27T14:32:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.375+0000 7fc66e761640 1 -- 172.21.15.46:0/1696099490 wait complete. 2024-01-27T14:32:33.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.1 2024-01-27T14:32:33.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.392+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2220036e40 con 0x7f222c150970 2024-01-27T14:32:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.403+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2220079b80 con 0x7f222c150970 2024-01-27T14:32:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.430+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0eb80c2540 con 0x7f0eb80c6580 2024-01-27T14:32:33.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.463+0000 7ff397fff640 1 -- 172.21.15.46:0/2380242220 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3a8044090 con 0x7ff3b0158150 2024-01-27T14:32:33.460 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T14:32:33.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 msgr2=0x7ff39c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 0x7ff39c06d410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009670 tx=0x7ff3a0006bf0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 msgr2=0x7ff3b0161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8033000 tx=0x7ff3a8004a40 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 shutdown_connections 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff39c06af50 0x7ff39c06d410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b0158150 0x7ff3b0161370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3b00ccc70 0x7ff3b0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 --2- 172.21.15.46:0/2380242220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00c8630 0x7ff3b00cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.465+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 >> 172.21.15.46:0/2380242220 conn(0x7ff3b00cbf80 msgr2=0x7ff3b00c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.466+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 shutdown_connections 2024-01-27T14:32:33.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.466+0000 7ff3b5ace640 1 -- 172.21.15.46:0/2380242220 wait complete. 2024-01-27T14:32:33.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.2 2024-01-27T14:32:33.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.525+0000 7f0eae7fc640 1 -- 172.21.15.46:0/14489380 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0eb4015070 con 0x7f0eb80c6580 2024-01-27T14:32:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:60129542159 2024-01-27T14:32:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 msgr2=0x7f0e9c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 0x7f0e9c06d410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097a0 tx=0x7f0ea803b040 comp rx=0 tx=0).stop 2024-01-27T14:32:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 msgr2=0x7f0eb8141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b410 tx=0x7f0eb400b8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 shutdown_connections 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f0e9c06af50 0x7f0e9c06d410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0eb81504f0 0x7f0eb814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0eb80c75a0 0x7f0eb81ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 --2- 172.21.15.46:0/14489380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0eb80c6580 0x7f0eb8141a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 >> 172.21.15.46:0/14489380 conn(0x7f0eb80c8140 msgr2=0x7f0eb80c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 shutdown_connections 2024-01-27T14:32:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.527+0000 7f0ebfa77640 1 -- 172.21.15.46:0/14489380 wait complete. 2024-01-27T14:32:33.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.6 2024-01-27T14:32:33.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.599+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f222c14f720 con 0x7f222c150970 2024-01-27T14:32:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.606+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0cc0c7200 con 0x7fd0cc0cca70 2024-01-27T14:32:33.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.625+0000 7f2228ff9640 1 -- 172.21.15.46:0/1511374907 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f222c14f720 con 0x7f222c150970 2024-01-27T14:32:33.622 INFO:teuthology.orchestra.run.smithi046.stdout:64424509456 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 msgr2=0x7f221806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 0x7f221806d3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a770 tx=0x7f221c008040 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 msgr2=0x7f222c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222002e1b0 tx=0x7f22200046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 shutdown_connections 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f221806af20 0x7f221806d3e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f222c156580 0x7f222c1466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f222c150970 0x7f222c0c9d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 --2- 172.21.15.46:0/1511374907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f222c0c8630 0x7f222c14a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 >> 172.21.15.46:0/1511374907 conn(0x7f222c0cbf80 msgr2=0x7f222c0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 shutdown_connections 2024-01-27T14:32:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.628+0000 7f2232733640 1 -- 172.21.15.46:0/1511374907 wait complete. 2024-01-27T14:32:33.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.5 2024-01-27T14:32:33.636 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:33.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.655+0000 7fd0c8ff9640 1 -- 172.21.15.46:0/695356976 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0c0035020 con 0x7fd0cc0cca70 2024-01-27T14:32:33.651 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 msgr2=0x7fd0b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 0x7fd0b806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0099a0 tx=0x7fd0bc0090e0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 msgr2=0x7fd0cc156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc156880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0033000 tx=0x7fd0c00046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 shutdown_connections 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd0b806aed0 0x7fd0b806d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0cc0cca70 0x7fd0cc156880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0cc151980 0x7fd0cc152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 --2- 172.21.15.46:0/695356976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc06ac00 0x7fd0cc157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 >> 172.21.15.46:0/695356976 conn(0x7fd0cc0cbf80 msgr2=0x7fd0cc0c4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 shutdown_connections 2024-01-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:33.657+0000 7fd0d28ec640 1 -- 172.21.15.46:0/695356976 wait complete. 2024-01-27T14:32:33.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.0 2024-01-27T14:32:33.665 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:34.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-27T14:32:34.123 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-27T14:32:34.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-27T14:32:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.223+0000 7ff0661ea640 1 Processor -- start 2024-01-27T14:32:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.223+0000 7ff0661ea640 1 -- start start 2024-01-27T14:32:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.224+0000 7ff0661ea640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 0x7ff0600c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.224+0000 7ff0661ea640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600668b0 con 0x7ff0601504f0 2024-01-27T14:32:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.224+0000 7ff0661ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600c54f0 con 0x7ff0600c6580 2024-01-27T14:32:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.224+0000 7ff0661ea640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600c47a0 con 0x7ff0600c75a0 2024-01-27T14:32:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.225+0000 7ff05f7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff0601504f0 0x7ff060156e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57434/0 (socket says 172.21.15.46:57434) 2024-01-27T14:32:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.225+0000 7ff05f7fe640 1 -- 172.21.15.46:0/545403485 learned_addr learned my addr 172.21.15.46:0/545403485 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.225+0000 7ff05effd640 1 --2- 172.21.15.46:0/545403485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 0x7ff0600c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17155246 0 0) 0x7ff0600668b0 con 0x7ff0601504f0 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048005730 con 0x7ff0601504f0 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21499940 0 0) 0x7ff0600c54f0 con 0x7ff0600c6580 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0600668b0 con 0x7ff0600c6580 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05effd640 1 -- 172.21.15.46:0/545403485 >> v1:172.21.15.73:6789/0 conn(0x7ff0600c6580 legacy=0x7ff0600c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05effd640 1 -- 172.21.15.46:0/545403485 >> v1:172.21.15.46:6789/0 conn(0x7ff0601504f0 legacy=0x7ff060156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.228+0000 7ff05effd640 1 -- 172.21.15.46:0/545403485 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600c57d0 con 0x7ff0600c75a0 2024-01-27T14:32:34.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.231+0000 7ff05effd640 1 --2- 172.21.15.46:0/545403485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 0x7ff0600c6040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097d0 tx=0x7ff05402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77dbf53e3415a2c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.235+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054030880 con 0x7ff0600c75a0 2024-01-27T14:32:34.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.235+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0540309e0 con 0x7ff0600c75a0 2024-01-27T14:32:34.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.235+0000 7ff05e7fc640 1 -- 172.21.15.46:0/545403485 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054030d70 con 0x7ff0600c75a0 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 -- 172.21.15.46:0/545403485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 msgr2=0x7ff0600c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 --2- 172.21.15.46:0/545403485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 0x7ff0600c6040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097d0 tx=0x7ff05402b9c0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 -- 172.21.15.46:0/545403485 shutdown_connections 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 --2- 172.21.15.46:0/545403485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0600c75a0 0x7ff0600c6040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 -- 172.21.15.46:0/545403485 >> 172.21.15.46:0/545403485 conn(0x7ff0600c8140 msgr2=0x7ff0600c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 -- 172.21.15.46:0/545403485 shutdown_connections 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.236+0000 7ff0661ea640 1 -- 172.21.15.46:0/545403485 wait complete. 2024-01-27T14:32:34.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.237+0000 7ff0661ea640 1 Processor -- start 2024-01-27T14:32:34.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.237+0000 7ff0661ea640 1 -- start start 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 0x7ff0601454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0600c75a0 0x7ff06014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 0x7ff0601462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060066b50 con 0x7ff0600c75a0 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601e1f30 con 0x7ff0600c6580 2024-01-27T14:32:34.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff0661ea640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601df7d0 con 0x7ff0601504f0 2024-01-27T14:32:34.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff05f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 0x7ff0601454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.238+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 0x7ff0601462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.239+0000 7ff05effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0600c75a0 0x7ff06014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.239+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 0x7ff0601462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47746/0 (socket says 172.21.15.46:47746) 2024-01-27T14:32:34.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.239+0000 7ff05ffff640 1 -- 172.21.15.46:0/2645039213 learned_addr learned my addr 172.21.15.46:0/2645039213 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.242+0000 7ff05f7fe640 1 -- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 msgr2=0x7ff0601462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.242+0000 7ff05f7fe640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 0x7ff0601462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.242+0000 7ff05f7fe640 1 -- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0600c75a0 msgr2=0x7ff06014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.242+0000 7ff05f7fe640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0600c75a0 0x7ff06014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.242+0000 7ff05f7fe640 1 -- 172.21.15.46:0/2645039213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009400 con 0x7ff0600c6580 2024-01-27T14:32:34.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.245+0000 7ff05f7fe640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 0x7ff0601454f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c3c0 tx=0x7ff05000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.248+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050005ce0 con 0x7ff0600c6580 2024-01-27T14:32:34.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.248+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050005e60 con 0x7ff0600c6580 2024-01-27T14:32:34.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.248+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050007310 con 0x7ff0600c6580 2024-01-27T14:32:34.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.248+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0601e22c0 con 0x7ff0600c6580 2024-01-27T14:32:34.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.249+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060145b30 con 0x7ff0600c6580 2024-01-27T14:32:34.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.250+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060067e60 con 0x7ff0600c6580 2024-01-27T14:32:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.268+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff050007470 con 0x7ff0600c6580 2024-01-27T14:32:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.269+0000 7ff047fff640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 0x7ff04c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.269+0000 7ff05effd640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 0x7ff04c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.269+0000 7ff05effd640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 0x7ff04c06d3e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff054036000 tx=0x7ff054008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.271+0000 7f921541d640 1 Processor -- start 2024-01-27T14:32:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.271+0000 7f921541d640 1 -- start start 2024-01-27T14:32:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff050007720 con 0x7ff0600c6580 2024-01-27T14:32:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f921541d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f921541d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92100c9380 0x7f921015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f921541d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921015aad0 con 0x7f9210151810 2024-01-27T14:32:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f921541d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9210158500 con 0x7f92100c9380 2024-01-27T14:32:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f921541d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921015b090 con 0x7f92100ca3d0 2024-01-27T14:32:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.272+0000 7f920e7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.273+0000 7f920e7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47760/0 (socket says 172.21.15.46:47760) 2024-01-27T14:32:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.273+0000 7f920e7fc640 1 -- 172.21.15.46:0/2158015581 learned_addr learned my addr 172.21.15.46:0/2158015581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.275+0000 7f920e7fc640 1 -- 172.21.15.46:0/2158015581 >> v2:172.21.15.73:3300/0 conn(0x7f92100c9380 msgr2=0x7f921015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.275+0000 7f920e7fc640 1 --2- 172.21.15.46:0/2158015581 >> v2:172.21.15.73:3300/0 conn(0x7f92100c9380 0x7f921015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.275+0000 7f920e7fc640 1 -- 172.21.15.46:0/2158015581 >> v1:172.21.15.73:6789/0 conn(0x7f9210151810 legacy=0x7f9210070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.275+0000 7f920e7fc640 1 -- 172.21.15.46:0/2158015581 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210157c60 con 0x7f92100ca3d0 2024-01-27T14:32:34.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.277+0000 7f920e7fc640 1 --2- 172.21.15.46:0/2158015581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b742bfee21850df7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f920dffb640 1 -- 172.21.15.46:0/2158015581 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204030840 con 0x7f92100ca3d0 2024-01-27T14:32:34.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f920dffb640 1 -- 172.21.15.46:0/2158015581 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040309a0 con 0x7f92100ca3d0 2024-01-27T14:32:34.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f920dffb640 1 -- 172.21.15.46:0/2158015581 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204030d30 con 0x7f92100ca3d0 2024-01-27T14:32:34.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 -- 172.21.15.46:0/2158015581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 msgr2=0x7f92100ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 --2- 172.21.15.46:0/2158015581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:34.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 -- 172.21.15.46:0/2158015581 shutdown_connections 2024-01-27T14:32:34.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 --2- 172.21.15.46:0/2158015581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92100ca3d0 0x7f92100ccd10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 --2- 172.21.15.46:0/2158015581 >> v2:172.21.15.73:3300/0 conn(0x7f92100c9380 0x7f921015b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 -- 172.21.15.46:0/2158015581 >> 172.21.15.46:0/2158015581 conn(0x7f9210066c80 msgr2=0x7f921006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 -- 172.21.15.46:0/2158015581 shutdown_connections 2024-01-27T14:32:34.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.281+0000 7f921541d640 1 -- 172.21.15.46:0/2158015581 wait complete. 2024-01-27T14:32:34.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 Processor -- start 2024-01-27T14:32:34.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 -- start start 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92100c9380 0x7f92100c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92100ca3d0 0x7f92101f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c5b30 con 0x7f92100ca3d0 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92101f3a40 con 0x7f92100c9380 2024-01-27T14:32:34.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.283+0000 7f921541d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c5ff0 con 0x7f9210151810 2024-01-27T14:32:34.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.284+0000 7f920f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.284+0000 7f920e7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92100ca3d0 0x7f92101f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.284+0000 7f920f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:47762/0 (socket says 172.21.15.46:47762) 2024-01-27T14:32:34.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.284+0000 7f920f7fe640 1 -- 172.21.15.46:0/1776728339 learned_addr learned my addr 172.21.15.46:0/1776728339 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.288+0000 7f920f7fe640 1 -- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92100c9380 msgr2=0x7f92100c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.288+0000 7f920f7fe640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92100c9380 0x7f92100c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.288+0000 7f920f7fe640 1 -- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92100ca3d0 msgr2=0x7f92101f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.288+0000 7f920f7fe640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92100ca3d0 0x7f92101f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.288+0000 7f920f7fe640 1 -- 172.21.15.46:0/1776728339 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040094d0 con 0x7f9210151810 2024-01-27T14:32:34.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.290+0000 7f920f7fe640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f920800b440 tx=0x7f920800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.293+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208011830 con 0x7f9210151810 2024-01-27T14:32:34.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.293+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208011990 con 0x7f9210151810 2024-01-27T14:32:34.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.293+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208011d40 con 0x7f9210151810 2024-01-27T14:32:34.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.293+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92101f0450 con 0x7f9210151810 2024-01-27T14:32:34.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.294+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92101ef690 con 0x7f9210151810 2024-01-27T14:32:34.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.295+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9210068310 con 0x7f9210151810 2024-01-27T14:32:34.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.314+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f920801a400 con 0x7f9210151810 2024-01-27T14:32:34.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.314+0000 7f91f77fe640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 0x7f91fc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.314+0000 7f920effd640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 0x7f91fc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.315+0000 7f920effd640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 0x7f91fc06d410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9200001c60 tx=0x7f9200007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.317+0000 7f60d15c8640 1 Processor -- start 2024-01-27T14:32:34.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.317+0000 7f60d15c8640 1 -- start start 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.318+0000 7f60d15c8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60cc153cb0 0x7f60cc0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.318+0000 7f60d15c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60cc06b0d0 0x7f60cc06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.318+0000 7f60d15c8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0c2ef0 con 0x7f60cc06ddf0 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.318+0000 7f60d15c8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc154090 con 0x7f60cc153cb0 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.318+0000 7f60d15c8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc159870 con 0x7f60cc06b0d0 2024-01-27T14:32:34.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.319+0000 7f60caffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60cc153cb0 0x7f60cc0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.319+0000 7f60cb7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f60cc06ddf0 0x7f60cc06ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57438/0 (socket says 172.21.15.46:57438) 2024-01-27T14:32:34.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.319+0000 7f60cb7fe640 1 -- 172.21.15.46:0/3891710338 learned_addr learned my addr 172.21.15.46:0/3891710338 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:34.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.322+0000 7f60caffd640 1 -- 172.21.15.46:0/3891710338 >> v2:172.21.15.73:3300/0 conn(0x7f60cc06b0d0 msgr2=0x7f60cc06d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.322+0000 7f60caffd640 1 --2- 172.21.15.46:0/3891710338 >> v2:172.21.15.73:3300/0 conn(0x7f60cc06b0d0 0x7f60cc06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.322+0000 7f60caffd640 1 -- 172.21.15.46:0/3891710338 >> v1:172.21.15.46:6789/0 conn(0x7f60cc06ddf0 legacy=0x7f60cc06ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.322+0000 7f60caffd640 1 -- 172.21.15.46:0/3891710338 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc159a80 con 0x7f60cc153cb0 2024-01-27T14:32:34.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.326+0000 7f60caffd640 1 --2- 172.21.15.46:0/3891710338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc153cb0 0x7f60cc0c2640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06eb40 tx=0x7f60bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e5a5c82638ffdc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.330+0000 7f60ca7fc640 1 -- 172.21.15.46:0/3891710338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc030610 con 0x7f60cc153cb0 2024-01-27T14:32:34.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.330+0000 7f60ca7fc640 1 -- 172.21.15.46:0/3891710338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc030770 con 0x7f60cc153cb0 2024-01-27T14:32:34.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.330+0000 7f60ca7fc640 1 -- 172.21.15.46:0/3891710338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc030b00 con 0x7f60cc153cb0 2024-01-27T14:32:34.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.330+0000 7f60d15c8640 1 -- 172.21.15.46:0/3891710338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc153cb0 msgr2=0x7f60cc0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.330+0000 7f60d15c8640 1 --2- 172.21.15.46:0/3891710338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc153cb0 0x7f60cc0c2640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06eb40 tx=0x7f60bc02b960 comp rx=0 tx=0).stop 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 -- 172.21.15.46:0/3891710338 shutdown_connections 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 --2- 172.21.15.46:0/3891710338 >> v2:172.21.15.73:3300/0 conn(0x7f60cc06b0d0 0x7f60cc06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 --2- 172.21.15.46:0/3891710338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc153cb0 0x7f60cc0c2640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 -- 172.21.15.46:0/3891710338 >> 172.21.15.46:0/3891710338 conn(0x7f60cc0cbf80 msgr2=0x7f60cc0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 -- 172.21.15.46:0/3891710338 shutdown_connections 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.331+0000 7f60d15c8640 1 -- 172.21.15.46:0/3891710338 wait complete. 2024-01-27T14:32:34.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.332+0000 7f60d15c8640 1 Processor -- start 2024-01-27T14:32:34.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.332+0000 7f60d15c8640 1 -- start start 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc06b0d0 0x7f60cc1f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60cc153cb0 0x7f60cc148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0cbd10 con 0x7f60cc06ddf0 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc1f3580 con 0x7f60cc06b0d0 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60d15c8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0cb1d0 con 0x7f60cc153cb0 2024-01-27T14:32:34.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53252/0 (socket says 172.21.15.46:53252) 2024-01-27T14:32:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.333+0000 7f60c3fff640 1 -- 172.21.15.46:0/1647050805 learned_addr learned my addr 172.21.15.46:0/1647050805 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.337+0000 7f60c3fff640 1 -- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60cc153cb0 msgr2=0x7f60cc148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.337+0000 7f60c3fff640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60cc153cb0 0x7f60cc148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.337+0000 7f60c3fff640 1 -- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc06b0d0 msgr2=0x7f60cc1f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.337+0000 7f60c3fff640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc06b0d0 0x7f60cc1f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.337+0000 7f60c3fff640 1 -- 172.21.15.46:0/1647050805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009400 con 0x7f60cc06ddf0 2024-01-27T14:32:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.339+0000 7f60c3fff640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60b400b4a0 tx=0x7f60b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.343+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4010610 con 0x7f60cc06ddf0 2024-01-27T14:32:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.343+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4010770 con 0x7f60cc06ddf0 2024-01-27T14:32:34.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.343+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc1f3f50 con 0x7f60cc06ddf0 2024-01-27T14:32:34.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.343+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4010b20 con 0x7f60cc06ddf0 2024-01-27T14:32:34.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.343+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0cb470 con 0x7f60cc06ddf0 2024-01-27T14:32:34.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.344+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0cb7b0 con 0x7f60cc06ddf0 2024-01-27T14:32:34.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-27T14:32:34.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-27T14:32:34.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.496+0000 7f921e80e640 1 Processor -- start 2024-01-27T14:32:34.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.497+0000 7f921e80e640 1 -- start start 2024-01-27T14:32:34.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.497+0000 7f921e80e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 0x7f9218161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.497+0000 7f921e80e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9218150d50 con 0x7f92180c8630 2024-01-27T14:32:34.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.497+0000 7f921e80e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180c0fa0 con 0x7f9218150970 2024-01-27T14:32:34.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.497+0000 7f921e80e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c1e80 con 0x7f921806dfc0 2024-01-27T14:32:34.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.516+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff050053db0 con 0x7ff0600c6580 2024-01-27T14:32:34.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.519+0000 7f9217fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9218150970 0x7f92180c7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46784/0 (socket says 172.21.15.46:46784) 2024-01-27T14:32:34.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.519+0000 7f9217fff640 1 -- 172.21.15.46:0/2305151327 learned_addr learned my addr 172.21.15.46:0/2305151327 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:34.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.523+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179995544 0 0) 0x7f92180c0fa0 con 0x7f9218150970 2024-01-27T14:32:34.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.523+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9200003520 con 0x7f9218150970 2024-01-27T14:32:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56105507 0 0) 0x7f9200003520 con 0x7f9218150970 2024-01-27T14:32:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 msgr2=0x7f9218161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 0x7f9218161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 >> v1:172.21.15.46:6789/0 conn(0x7f92180c8630 legacy=0x7f921806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c1200 con 0x7f9218150970 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 500855061 0 0) 0x7f9208001670 con 0x7f9218150970 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 >> v1:172.21.15.73:6789/0 conn(0x7f9218150970 legacy=0x7f92180c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 0x7f9200003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f92000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9200004e20 0x7f920000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c1e80 con 0x7f9200004e20 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200005590 con 0x7f92000040b0 2024-01-27T14:32:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.528+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920000bec0 con 0x7f921806dfc0 2024-01-27T14:32:34.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.531+0000 7f92177fe640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f92000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.533+0000 7f92177fe640 1 -- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 msgr2=0x7f9200003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.533+0000 7f92177fe640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921806dfc0 0x7f9200003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.533+0000 7f92177fe640 1 -- 172.21.15.46:0/2305151327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9200004e20 msgr2=0x7f920000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.533+0000 7f92177fe640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9200004e20 0x7f920000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.533+0000 7f92177fe640 1 -- 172.21.15.46:0/2305151327 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9200003520 con 0x7f92000040b0 2024-01-27T14:32:34.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.535+0000 7f92177fe640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f92000047c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f920c001640 tx=0x7f92000057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21fabfe6a2af1248 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.539+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c005270 con 0x7f92000040b0 2024-01-27T14:32:34.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.539+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c02e070 con 0x7f92000040b0 2024-01-27T14:32:34.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.539+0000 7f9216ffd640 1 -- 172.21.15.46:0/2305151327 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c003610 con 0x7f92000040b0 2024-01-27T14:32:34.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 -- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 msgr2=0x7f92000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 --2- 172.21.15.46:0/2305151327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f92000047c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f920c001640 tx=0x7f92000057f0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921cdab640 1 -- 172.21.15.46:0/2305151327 reap_dead start 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 -- 172.21.15.46:0/2305151327 shutdown_connections 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 -- 172.21.15.46:0/2305151327 >> 172.21.15.46:0/2305151327 conn(0x7f92180cbf80 msgr2=0x7f92180cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 -- 172.21.15.46:0/2305151327 shutdown_connections 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.540+0000 7f921e80e640 1 -- 172.21.15.46:0/2305151327 wait complete. 2024-01-27T14:32:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.541+0000 7f921e80e640 1 Processor -- start 2024-01-27T14:32:34.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.541+0000 7f921e80e640 1 -- start start 2024-01-27T14:32:34.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181f0640 0x7f921806e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92181ed5d0 0x7f92181eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9218151880 con 0x7f92181f0640 2024-01-27T14:32:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ed0d0 con 0x7f92000040b0 2024-01-27T14:32:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f921e80e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92181edf70 con 0x7f92181ed5d0 2024-01-27T14:32:34.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-27T14:32:34.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.542+0000 7f9217fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.543+0000 7f9217fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50654/0 (socket says 172.21.15.46:50654) 2024-01-27T14:32:34.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.543+0000 7f9217fff640 1 -- 172.21.15.46:0/1743893234 learned_addr learned my addr 172.21.15.46:0/1743893234 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.546+0000 7f9217fff640 1 -- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92181ed5d0 msgr2=0x7f92181eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.546+0000 7f9217fff640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92181ed5d0 0x7f92181eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.546+0000 7f9217fff640 1 -- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181f0640 msgr2=0x7f921806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.546+0000 7f9217fff640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181f0640 0x7f921806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.546+0000 7f9217fff640 1 -- 172.21.15.46:0/1743893234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92181545b0 con 0x7f92000040b0 2024-01-27T14:32:34.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.548+0000 7f9217fff640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f920800c7d0 tx=0x7f920800cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.552+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080074e0 con 0x7f92000040b0 2024-01-27T14:32:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.552+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208007660 con 0x7f92000040b0 2024-01-27T14:32:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.552+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208004a20 con 0x7f92000040b0 2024-01-27T14:32:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.552+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9218154870 con 0x7f92000040b0 2024-01-27T14:32:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.552+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9218154e30 con 0x7f92000040b0 2024-01-27T14:32:34.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.553+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9208025e50 con 0x7f9210151810 2024-01-27T14:32:34.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.554+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92180742e0 con 0x7f92000040b0 2024-01-27T14:32:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.564+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9208054b50 con 0x7f9210151810 2024-01-27T14:32:34.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.584+0000 7f94b973c640 1 Processor -- start 2024-01-27T14:32:34.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.584+0000 7f94b973c640 1 -- start start 2024-01-27T14:32:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.585+0000 7f94b973c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.585+0000 7f94b973c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f94b406dfc0 0x7f94b40c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.585+0000 7f94b973c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b4150d50 con 0x7f94b40c8630 2024-01-27T14:32:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.585+0000 7f94b973c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40c1e80 con 0x7f94b406dfc0 2024-01-27T14:32:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.585+0000 7f94b973c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c0fa0 con 0x7f94b4150970 2024-01-27T14:32:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.586+0000 7f94b2ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.586+0000 7f94b2ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57346/0 (socket says 172.21.15.46:57346) 2024-01-27T14:32:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.586+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1201716258 learned_addr learned my addr 172.21.15.46:0/1201716258 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.588+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1201716258 >> v2:172.21.15.46:3300/0 conn(0x7f94b406dfc0 msgr2=0x7f94b40c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.588+0000 7f94b2ffd640 1 --2- 172.21.15.46:0/1201716258 >> v2:172.21.15.46:3300/0 conn(0x7f94b406dfc0 0x7f94b40c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.588+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1201716258 >> v1:172.21.15.46:6789/0 conn(0x7f94b40c8630 legacy=0x7f94b406d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.588+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1201716258 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40c1200 con 0x7f94b4150970 2024-01-27T14:32:34.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.591+0000 7f94b2ffd640 1 --2- 172.21.15.46:0/1201716258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009870 tx=0x7f94a402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d11697fb0061301 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.595+0000 7f94b1ffb640 1 -- 172.21.15.46:0/1201716258 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4030840 con 0x7f94b4150970 2024-01-27T14:32:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.595+0000 7f94b1ffb640 1 -- 172.21.15.46:0/1201716258 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a40309a0 con 0x7f94b4150970 2024-01-27T14:32:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.595+0000 7f94b1ffb640 1 -- 172.21.15.46:0/1201716258 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4030d30 con 0x7f94b4150970 2024-01-27T14:32:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.595+0000 7f94b973c640 1 -- 172.21.15.46:0/1201716258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 msgr2=0x7f94b40c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.595+0000 7f94b973c640 1 --2- 172.21.15.46:0/1201716258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009870 tx=0x7f94a402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 -- 172.21.15.46:0/1201716258 shutdown_connections 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 --2- 172.21.15.46:0/1201716258 >> v2:172.21.15.46:3300/0 conn(0x7f94b406dfc0 0x7f94b40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 --2- 172.21.15.46:0/1201716258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b4150970 0x7f94b40c7040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 -- 172.21.15.46:0/1201716258 >> 172.21.15.46:0/1201716258 conn(0x7f94b40cbf80 msgr2=0x7f94b40cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 -- 172.21.15.46:0/1201716258 shutdown_connections 2024-01-27T14:32:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.596+0000 7f94b973c640 1 -- 172.21.15.46:0/1201716258 wait complete. 2024-01-27T14:32:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.598+0000 7f94b973c640 1 Processor -- start 2024-01-27T14:32:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.598+0000 7f94b973c640 1 -- start start 2024-01-27T14:32:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b40c8630 0x7f94b413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94b4150970 0x7f94b4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b414cf50 con 0x7f94b40c8630 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b414b690 con 0x7f94b4150970 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.599+0000 7f94b973c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4139470 con 0x7f94b406dfc0 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.600+0000 7f94b2ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.600+0000 7f94b2ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57350/0 (socket says 172.21.15.46:57350) 2024-01-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.600+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1722043597 learned_addr learned my addr 172.21.15.46:0/1722043597 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.603+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94b4150970 msgr2=0x7f94b4143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.603+0000 7f94b2ffd640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94b4150970 0x7f94b4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.603+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b40c8630 msgr2=0x7f94b413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.603+0000 7f94b2ffd640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b40c8630 0x7f94b413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.603+0000 7f94b2ffd640 1 -- 172.21.15.46:0/1722043597 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40094d0 con 0x7f94b406dfc0 2024-01-27T14:32:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.605+0000 7f94b2ffd640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.609+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4039d60 con 0x7f94b406dfc0 2024-01-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.609+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4043400 con 0x7f94b406dfc0 2024-01-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.609+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b414c1d0 con 0x7f94b406dfc0 2024-01-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.609+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40437b0 con 0x7f94b406dfc0 2024-01-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.609+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b4147ae0 con 0x7f94b406dfc0 2024-01-27T14:32:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.610+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b40742e0 con 0x7f94b406dfc0 2024-01-27T14:32:34.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.649+0000 7f18a0cd3640 1 Processor -- start 2024-01-27T14:32:34.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.649+0000 7f18a0cd3640 1 -- start start 2024-01-27T14:32:34.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.650+0000 7f18a0cd3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f189c153cb0 0x7f189c0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.650+0000 7f18a0cd3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f189c06b0d0 0x7f189c06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.650+0000 7f18a0cd3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c0c2ef0 con 0x7f189c06ddf0 2024-01-27T14:32:34.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.650+0000 7f18a0cd3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c154090 con 0x7f189c153cb0 2024-01-27T14:32:34.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.650+0000 7f18a0cd3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c159870 con 0x7f189c06b0d0 2024-01-27T14:32:34.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.658+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f60b4010c80 con 0x7f60cc06ddf0 2024-01-27T14:32:34.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.658+0000 7f60c37fe640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 0x7f60ac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.658+0000 7f60caffd640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 0x7f60ac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.659+0000 7f60caffd640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 0x7f60ac06d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60bc036000 tx=0x7f60bc030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.674+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f60b4058910 con 0x7f60cc06ddf0 2024-01-27T14:32:34.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.674+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f60b4054550 con 0x7f60cc06ddf0 2024-01-27T14:32:34.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.687+0000 7f189a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f189c153cb0 0x7f189c0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.689+0000 7f189a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f189c153cb0 0x7f189c0c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35452/0 (socket says 172.21.15.46:35452) 2024-01-27T14:32:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.689+0000 7f189a59c640 1 -- 172.21.15.46:0/2876845521 learned_addr learned my addr 172.21.15.46:0/2876845521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.693+0000 7f189a59c640 1 -- 172.21.15.46:0/2876845521 >> v2:172.21.15.73:3300/0 conn(0x7f189c06b0d0 msgr2=0x7f189c06d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.693+0000 7f189a59c640 1 --2- 172.21.15.46:0/2876845521 >> v2:172.21.15.73:3300/0 conn(0x7f189c06b0d0 0x7f189c06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.693+0000 7f189a59c640 1 -- 172.21.15.46:0/2876845521 >> v1:172.21.15.73:6789/0 conn(0x7f189c06ddf0 legacy=0x7f189c06ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:34.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.693+0000 7f189a59c640 1 -- 172.21.15.46:0/2876845521 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c159a80 con 0x7f189c153cb0 2024-01-27T14:32:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.697+0000 7f189a59c640 1 --2- 172.21.15.46:0/2876845521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c153cb0 0x7f189c0c2640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f189c06eb40 tx=0x7f188c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f46b5e4f9868dfe server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.703+0000 7f189959a640 1 -- 172.21.15.46:0/2876845521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c030860 con 0x7f189c153cb0 2024-01-27T14:32:34.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.703+0000 7f189959a640 1 -- 172.21.15.46:0/2876845521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0309c0 con 0x7f189c153cb0 2024-01-27T14:32:34.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.703+0000 7f189959a640 1 -- 172.21.15.46:0/2876845521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c030d50 con 0x7f189c153cb0 2024-01-27T14:32:34.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 -- 172.21.15.46:0/2876845521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c153cb0 msgr2=0x7f189c0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/2876845521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c153cb0 0x7f189c0c2640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f189c06eb40 tx=0x7f188c02b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 -- 172.21.15.46:0/2876845521 shutdown_connections 2024-01-27T14:32:34.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/2876845521 >> v2:172.21.15.73:3300/0 conn(0x7f189c06b0d0 0x7f189c06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/2876845521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c153cb0 0x7f189c0c2640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.704+0000 7f18a0cd3640 1 -- 172.21.15.46:0/2876845521 >> 172.21.15.46:0/2876845521 conn(0x7f189c0cbf80 msgr2=0x7f189c0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.705+0000 7f18a0cd3640 1 -- 172.21.15.46:0/2876845521 shutdown_connections 2024-01-27T14:32:34.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.705+0000 7f18a0cd3640 1 -- 172.21.15.46:0/2876845521 wait complete. 2024-01-27T14:32:34.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.707+0000 7f18a0cd3640 1 Processor -- start 2024-01-27T14:32:34.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.707+0000 7f18a0cd3640 1 -- start start 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f189c06ddf0 0x7f189c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f189c153cb0 0x7f189c1e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c155c20 con 0x7f189c06b0d0 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1ef890 con 0x7f189c153cb0 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f18a0cd3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1f0710 con 0x7f189c06ddf0 2024-01-27T14:32:34.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.708+0000 7f189a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.709+0000 7f189a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35462/0 (socket says 172.21.15.46:35462) 2024-01-27T14:32:34.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.709+0000 7f189a59c640 1 -- 172.21.15.46:0/573187642 learned_addr learned my addr 172.21.15.46:0/573187642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:34.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.713+0000 7f189a59c640 1 -- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f189c06ddf0 msgr2=0x7f189c152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.713+0000 7f189a59c640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f189c06ddf0 0x7f189c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.713+0000 7f189a59c640 1 -- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f189c153cb0 msgr2=0x7f189c1e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.713+0000 7f189a59c640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f189c153cb0 0x7f189c1e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.713+0000 7f189a59c640 1 -- 172.21.15.46:0/573187642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0094d0 con 0x7f189c06b0d0 2024-01-27T14:32:34.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.715+0000 7f189a59c640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f188c000c00 tx=0x7f188c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.719+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff0601e22c0 con 0x7ff0600c6580 2024-01-27T14:32:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.720+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c039b60 con 0x7f189c06b0d0 2024-01-27T14:32:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.720+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c039cc0 con 0x7f189c06b0d0 2024-01-27T14:32:34.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.721+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c043610 con 0x7f189c06b0d0 2024-01-27T14:32:34.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.721+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c1efb00 con 0x7f189c06b0d0 2024-01-27T14:32:34.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.721+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c1f00c0 con 0x7f189c06b0d0 2024-01-27T14:32:34.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.722+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c0742e0 con 0x7f189c06b0d0 2024-01-27T14:32:34.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.747+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f188c04c3b0 con 0x7f189c06b0d0 2024-01-27T14:32:34.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.747+0000 7f188affd640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 0x7f187c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.747+0000 7f1899d9b640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 0x7f187c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.748+0000 7f1899d9b640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 0x7f187c06d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f189c148d30 tx=0x7f1890006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.751+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f188c039e30 con 0x7f189c06b0d0 2024-01-27T14:32:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.795+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f92100742e0 con 0x7f9210151810 2024-01-27T14:32:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.808+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f920800a5e0 con 0x7f92000040b0 2024-01-27T14:32:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.809+0000 7f9214ff9640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.809+0000 7f92177fe640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.810+0000 7f92177fe640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f920c033000 tx=0x7f920c005000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.811+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f92080580f0 con 0x7f92000040b0 2024-01-27T14:32:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.822+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f92080577c0 con 0x7f92000040b0 2024-01-27T14:32:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.825+0000 7ff047fff640 1 -- 172.21.15.46:0/2645039213 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0601e22c0 con 0x7ff0600c6580 2024-01-27T14:32:34.822 INFO:teuthology.orchestra.run.smithi046.stdout:60129542161 2024-01-27T14:32:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 msgr2=0x7ff04c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 0x7ff04c06d3e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff054036000 tx=0x7ff054008030 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 msgr2=0x7ff0601454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 0x7ff0601454f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c3c0 tx=0x7ff05000c880 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 shutdown_connections 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff04c06af20 0x7ff04c06d3e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0601504f0 0x7ff0601462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0600c75a0 0x7ff06014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 --2- 172.21.15.46:0/2645039213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600c6580 0x7ff0601454f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.827+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 >> 172.21.15.46:0/2645039213 conn(0x7ff0600c8140 msgr2=0x7ff06014eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.828+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 shutdown_connections 2024-01-27T14:32:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.828+0000 7ff0661ea640 1 -- 172.21.15.46:0/2645039213 wait complete. 2024-01-27T14:32:34.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542161 for osd.4 2024-01-27T14:32:34.836 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.864+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f94a4043910 con 0x7f94b406dfc0 2024-01-27T14:32:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.864+0000 7f949b7fe640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 0x7f94a006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.865+0000 7f94b27fc640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 0x7f94a006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.865+0000 7f94b27fc640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 0x7f94a006d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94b4145270 tx=0x7f94a8006ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:34.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.868+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f94a403e070 con 0x7f94b406dfc0 2024-01-27T14:32:34.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.877+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f94a4077fe0 con 0x7f94b406dfc0 2024-01-27T14:32:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.889+0000 7f91f77fe640 1 -- 172.21.15.46:0/1776728339 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9208015070 con 0x7f9210151810 2024-01-27T14:32:34.886 INFO:teuthology.orchestra.run.smithi046.stdout:64424509456 2024-01-27T14:32:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.891+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f60cc0742e0 con 0x7f60cc06ddf0 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 msgr2=0x7f91fc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 0x7f91fc06d410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9200001c60 tx=0x7f9200007d10 comp rx=0 tx=0).stop 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 msgr2=0x7f9210148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f920800b440 tx=0x7f920800b900 comp rx=0 tx=0).stop 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 shutdown_connections 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f91fc06af50 0x7f91fc06d410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9210151810 0x7f9210148d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92100ca3d0 0x7f92101f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 --2- 172.21.15.46:0/1776728339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92100c9380 0x7f92100c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 >> 172.21.15.46:0/1776728339 conn(0x7f9210066c80 msgr2=0x7f92100cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 shutdown_connections 2024-01-27T14:32:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:34.892+0000 7f921541d640 1 -- 172.21.15.46:0/1776728339 wait complete. 2024-01-27T14:32:34.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.7 2024-01-27T14:32:34.904 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:35.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.025+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9218153f00 con 0x7f92000040b0 2024-01-27T14:32:35.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.028+0000 7f9214ff9640 1 -- 172.21.15.46:0/1743893234 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9208018070 con 0x7f92000040b0 2024-01-27T14:32:35.025 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 msgr2=0x7f920406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f920c033000 tx=0x7f920c005000 comp rx=0 tx=0).stop 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 msgr2=0x7f9218151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f920800c7d0 tx=0x7f920800cc90 comp rx=0 tx=0).stop 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 shutdown_connections 2024-01-27T14:32:35.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92181ed5d0 0x7f92181eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181f0640 0x7f921806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 --2- 172.21.15.46:0/1743893234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92000040b0 0x7f9218151340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 >> 172.21.15.46:0/1743893234 conn(0x7f92180cbf80 msgr2=0x7f92180ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 shutdown_connections 2024-01-27T14:32:35.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.030+0000 7f921e80e640 1 -- 172.21.15.46:0/1743893234 wait complete. 2024-01-27T14:32:35.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.033+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f188c0771e0 con 0x7f189c06b0d0 2024-01-27T14:32:35.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.1 2024-01-27T14:32:35.038 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.086+0000 7f60c37fe640 1 -- 172.21.15.46:0/1647050805 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60b401e020 con 0x7f60cc06ddf0 2024-01-27T14:32:35.083 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.086+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94b4150d50 con 0x7f94b406dfc0 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 msgr2=0x7f60ac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 0x7f60ac06d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60bc036000 tx=0x7f60bc030000 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 msgr2=0x7f60cc147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60b400b4a0 tx=0x7f60b400b960 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 shutdown_connections 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f60ac06af50 0x7f60ac06d410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60cc153cb0 0x7f60cc148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60cc06ddf0 0x7f60cc147d30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 --2- 172.21.15.46:0/1647050805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc06b0d0 0x7f60cc1f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 >> 172.21.15.46:0/1647050805 conn(0x7f60cc0cbf80 msgr2=0x7f60cc06ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 shutdown_connections 2024-01-27T14:32:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.088+0000 7f60d15c8640 1 -- 172.21.15.46:0/1647050805 wait complete. 2024-01-27T14:32:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.090+0000 7f949b7fe640 1 -- 172.21.15.46:0/1722043597 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94b4150d50 con 0x7f94b406dfc0 2024-01-27T14:32:35.086 INFO:teuthology.orchestra.run.smithi046.stdout:64424509455 2024-01-27T14:32:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 msgr2=0x7f94a006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 0x7f94a006d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94b4145270 tx=0x7f94a8006ba0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 msgr2=0x7f94b414e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4004730 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 shutdown_connections 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f94a006af20 0x7f94a006d3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94b4150970 0x7f94b4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b40c8630 0x7f94b413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 --2- 172.21.15.46:0/1722043597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94b406dfc0 0x7f94b414e410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 >> 172.21.15.46:0/1722043597 conn(0x7f94b40cbf80 msgr2=0x7f94b40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 shutdown_connections 2024-01-27T14:32:35.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.092+0000 7f94b973c640 1 -- 172.21.15.46:0/1722043597 wait complete. 2024-01-27T14:32:35.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.3 2024-01-27T14:32:35.097 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:35.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.2 2024-01-27T14:32:35.101 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:35.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.226+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f189c0c98c0 con 0x7f189c06b0d0 2024-01-27T14:32:35.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.249+0000 7f188affd640 1 -- 172.21.15.46:0/573187642 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f188c07a800 con 0x7f189c06b0d0 2024-01-27T14:32:35.246 INFO:teuthology.orchestra.run.smithi046.stdout:60129542161 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 msgr2=0x7f187c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 0x7f187c06d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f189c148d30 tx=0x7f1890006c90 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 msgr2=0x7f189c156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f188c000c00 tx=0x7f188c004730 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 shutdown_connections 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f187c06af20 0x7f187c06d3e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f189c153cb0 0x7f189c1e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f189c06ddf0 0x7f189c152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 --2- 172.21.15.46:0/573187642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189c06b0d0 0x7f189c156630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 >> 172.21.15.46:0/573187642 conn(0x7f189c0cbf80 msgr2=0x7f189c1512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 shutdown_connections 2024-01-27T14:32:35.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.251+0000 7f18a0cd3640 1 -- 172.21.15.46:0/573187642 wait complete. 2024-01-27T14:32:35.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.6 2024-01-27T14:32:35.258 DEBUG:teuthology.parallel:result is None 2024-01-27T14:32:35.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-27T14:32:35.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:32:35.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.365+0000 7fe5c21c5640 1 Processor -- start 2024-01-27T14:32:35.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.365+0000 7fe5c21c5640 1 -- start start 2024-01-27T14:32:35.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.365+0000 7fe5c21c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5bc0c4f50 0x7fe5bc15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5c21c5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5c21c5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc158400 con 0x7fe5bc0c5330 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5c21c5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc0cc560 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5c21c5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc06b910 con 0x7fe5bc157f00 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5baffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe5bc0c5330 0x7fe5bc150fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45320/0 (socket says 172.21.15.46:45320) 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5baffd640 1 -- 172.21.15.46:0/4019354184 learned_addr learned my addr 172.21.15.46:0/4019354184 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.366+0000 7fe5bb7fe640 1 --2- 172.21.15.46:0/4019354184 >> v2:172.21.15.73:3300/0 conn(0x7fe5bc0c4f50 0x7fe5bc15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.367+0000 7fe5bbfff640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5ba7fc640 1 -- 172.21.15.46:0/4019354184 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963524873 0 0) 0x7fe5bc158400 con 0x7fe5bc0c5330 2024-01-27T14:32:35.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5ba7fc640 1 -- 172.21.15.46:0/4019354184 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a8003520 con 0x7fe5bc0c5330 2024-01-27T14:32:35.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5bb7fe640 1 -- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 msgr2=0x7fe5bc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:35.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5bb7fe640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5bb7fe640 1 -- 172.21.15.46:0/4019354184 >> v1:172.21.15.46:6789/0 conn(0x7fe5bc0c5330 legacy=0x7fe5bc150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.369+0000 7fe5bb7fe640 1 -- 172.21.15.46:0/4019354184 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc06a7f0 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.371+0000 7fe5bb7fe640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc15aba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0097a0 tx=0x7fe5ac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4262379d72dab512 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5ba7fc640 1 -- 172.21.15.46:0/4019354184 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac031830 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5ba7fc640 1 -- 172.21.15.46:0/4019354184 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac031990 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5ba7fc640 1 -- 172.21.15.46:0/4019354184 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac031d20 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 -- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 msgr2=0x7fe5bc15aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc15aba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0097a0 tx=0x7fe5ac02b8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 -- 172.21.15.46:0/4019354184 shutdown_connections 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/4019354184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc15aba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.375+0000 7fe5c21c5640 1 -- 172.21.15.46:0/4019354184 >> 172.21.15.46:0/4019354184 conn(0x7fe5bc0cb5d0 msgr2=0x7fe5bc0cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.376+0000 7fe5c21c5640 1 -- 172.21.15.46:0/4019354184 shutdown_connections 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.376+0000 7fe5c21c5640 1 -- 172.21.15.46:0/4019354184 wait complete. 2024-01-27T14:32:35.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 Processor -- start 2024-01-27T14:32:35.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 -- start start 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1f0400 con 0x7fe5bc0c5330 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc156a20 con 0x7fe5bc0c4f50 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.377+0000 7fe5c21c5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc156d00 con 0x7fe5bc157f00 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.378+0000 7fe5baffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.378+0000 7fe5bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.378+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.378+0000 7fe5baffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35476/0 (socket says 172.21.15.46:35476) 2024-01-27T14:32:35.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.378+0000 7fe5baffd640 1 -- 172.21.15.46:0/322146178 learned_addr learned my addr 172.21.15.46:0/322146178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:35.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.382+0000 7fe5baffd640 1 -- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 msgr2=0x7fe5bc1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.382+0000 7fe5baffd640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.382+0000 7fe5baffd640 1 -- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 msgr2=0x7fe5bc143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.382+0000 7fe5baffd640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.382+0000 7fe5baffd640 1 -- 172.21.15.46:0/322146178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009400 con 0x7fe5bc0c5330 2024-01-27T14:32:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.384+0000 7fe5baffd640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400c400 tx=0x7fe5a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:35.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.386+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4005ce0 con 0x7fe5bc0c5330 2024-01-27T14:32:35.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.386+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc156fe0 con 0x7fe5bc0c5330 2024-01-27T14:32:35.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.386+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0ca690 con 0x7fe5bc0c5330 2024-01-27T14:32:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.387+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc066d20 con 0x7fe5bc0c5330 2024-01-27T14:32:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.387+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4005e40 con 0x7fe5bc0c5330 2024-01-27T14:32:35.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.387+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4007ea0 con 0x7fe5bc0c5330 2024-01-27T14:32:35.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.651+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe5a4007330 con 0x7fe5bc0c5330 2024-01-27T14:32:35.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.651+0000 7fe5b3fff640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:35.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.651+0000 7fe5bb7fe640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:35.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.652+0000 7fe5bb7fe640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 0x7fe59c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac036000 tx=0x7fe5ac03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:35.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.666+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe5a401de50 con 0x7fe5bc0c5330 2024-01-27T14:32:35.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.666+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe5a4054080 con 0x7fe5bc0c5330 2024-01-27T14:32:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.857+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5bc1f0270 con 0x7fe59c06aed0 2024-01-27T14:32:35.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.866+0000 7fe5b3fff640 1 -- 172.21.15.46:0/322146178 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364827 (secure 0 0 0) 0x7fe5bc1f0270 con 0x7fe59c06aed0 2024-01-27T14:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:32:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 msgr2=0x7fe59c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 0x7fe59c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac036000 tx=0x7fe5ac03c040 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 msgr2=0x7fe5bc1f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400c400 tx=0x7fe5a400c8c0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 shutdown_connections 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe5bc157f00 0x7fe5bc1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5bc0c5330 0x7fe5bc1f0890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 --2- 172.21.15.46:0/322146178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5bc0c4f50 0x7fe5bc143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 >> 172.21.15.46:0/322146178 conn(0x7fe5bc0cb5d0 msgr2=0x7fe5bc14e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 shutdown_connections 2024-01-27T14:32:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:35.869+0000 7fe5c21c5640 1 -- 172.21.15.46:0/322146178 wait complete. 2024-01-27T14:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-01-27T14:32:35.011318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600631,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":366,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236576,"kb_used_data":3808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738144,"statfs":{"total":773094113280,"available":772851859456,"internally_reserved":0,"allocated":3899392,"data_stored":2201922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004180"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995878+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:32:32.995878+0000","last_peered":"2024-01-27T14:32:32.995878+0000","last_clean":"2024-01-27T14:32:32.995878+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:32:32.995878+0000","last_undegraded":"2024-01-27T14:32:32.995878+0000","last_fullsized":"2024-01-27T14:32:32.995878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651376+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:32:21.651376+0000","last_peered":"2024-01-27T14:32:21.651376+0000","last_clean":"2024-01-27T14:32:21.651376+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:32:21.651376+0000","last_undegraded":"2024-01-27T14:32:21.651376+0000","last_fullsized":"2024-01-27T14:32:21.651376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292974+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:32:21.292974+0000","last_peered":"2024-01-27T14:32:21.292974+0000","last_clean":"2024-01-27T14:32:21.292974+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:32:21.292974+0000","last_undegraded":"2024-01-27T14:32:21.292974+0000","last_fullsized":"2024-01-27T14:32:21.292974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651507+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:32:21.651507+0000","last_peered":"2024-01-27T14:32:21.651507+0000","last_clean":"2024-01-27T14:32:21.651507+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:32:21.651507+0000","last_undegraded":"2024-01-27T14:32:21.651507+0000","last_fullsized":"2024-01-27T14:32:21.651507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651384+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:32:21.651384+0000","last_peered":"2024-01-27T14:32:21.651384+0000","last_clean":"2024-01-27T14:32:21.651384+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:32:21.651384+0000","last_undegraded":"2024-01-27T14:32:21.651384+0000","last_fullsized":"2024-01-27T14:32:21.651384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294582+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:32:21.294582+0000","last_peered":"2024-01-27T14:32:21.294582+0000","last_clean":"2024-01-27T14:32:21.294582+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:32:21.294582+0000","last_undegraded":"2024-01-27T14:32:21.294582+0000","last_fullsized":"2024-01-27T14:32:21.294582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.912349+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:32:32.912349+0000","last_peered":"2024-01-27T14:32:32.912349+0000","last_clean":"2024-01-27T14:32:32.912349+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:32:32.912349+0000","last_undegraded":"2024-01-27T14:32:32.912349+0000","last_fullsized":"2024-01-27T14:32:32.912349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241636+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:32:21.241636+0000","last_peered":"2024-01-27T14:32:21.241636+0000","last_clean":"2024-01-27T14:32:21.241636+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:32:21.241636+0000","last_undegraded":"2024-01-27T14:32:21.241636+0000","last_fullsized":"2024-01-27T14:32:21.241636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294900+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:32:21.294900+0000","last_peered":"2024-01-27T14:32:21.294900+0000","last_clean":"2024-01-27T14:32:21.294900+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:32:21.294900+0000","last_undegraded":"2024-01-27T14:32:21.294900+0000","last_fullsized":"2024-01-27T14:32:21.294900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.911741+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:32:32.911741+0000","last_peered":"2024-01-27T14:32:32.911741+0000","last_clean":"2024-01-27T14:32:32.911741+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:32:32.911741+0000","last_undegraded":"2024-01-27T14:32:32.911741+0000","last_fullsized":"2024-01-27T14:32:32.911741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652524+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:32:21.652524+0000","last_peered":"2024-01-27T14:32:21.652524+0000","last_clean":"2024-01-27T14:32:21.652524+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:32:21.652524+0000","last_undegraded":"2024-01-27T14:32:21.652524+0000","last_fullsized":"2024-01-27T14:32:21.652524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294671+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:32:21.294671+0000","last_peered":"2024-01-27T14:32:21.294671+0000","last_clean":"2024-01-27T14:32:21.294671+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:32:21.294671+0000","last_undegraded":"2024-01-27T14:32:21.294671+0000","last_fullsized":"2024-01-27T14:32:21.294671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651544+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:32:21.651544+0000","last_peered":"2024-01-27T14:32:21.651544+0000","last_clean":"2024-01-27T14:32:21.651544+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:32:21.651544+0000","last_undegraded":"2024-01-27T14:32:21.651544+0000","last_fullsized":"2024-01-27T14:32:21.651544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.868776+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:32:25.868776+0000","last_peered":"2024-01-27T14:32:25.868776+0000","last_clean":"2024-01-27T14:32:25.868776+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:32:25.868776+0000","last_undegraded":"2024-01-27T14:32:25.868776+0000","last_fullsized":"2024-01-27T14:32:25.868776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651027+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:32:21.651027+0000","last_peered":"2024-01-27T14:32:21.651027+0000","last_clean":"2024-01-27T14:32:21.651027+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:32:21.651027+0000","last_undegraded":"2024-01-27T14:32:21.651027+0000","last_fullsized":"2024-01-27T14:32:21.651027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293539+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:32:21.293539+0000","last_peered":"2024-01-27T14:32:21.293539+0000","last_clean":"2024-01-27T14:32:21.293539+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:32:21.293539+0000","last_undegraded":"2024-01-27T14:32:21.293539+0000","last_fullsized":"2024-01-27T14:32:21.293539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.011132+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:32:28.011132+0000","last_peered":"2024-01-27T14:32:28.011132+0000","last_clean":"2024-01-27T14:32:28.011132+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:32:28.011132+0000","last_undegraded":"2024-01-27T14:32:28.011132+0000","last_fullsized":"2024-01-27T14:32:28.011132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651904+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:32:21.651904+0000","last_peered":"2024-01-27T14:32:21.651904+0000","last_clean":"2024-01-27T14:32:21.651904+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:32:21.651904+0000","last_undegraded":"2024-01-27T14:32:21.651904+0000","last_fullsized":"2024-01-27T14:32:21.651904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237570+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:32:21.237570+0000","last_peered":"2024-01-27T14:32:21.237570+0000","last_clean":"2024-01-27T14:32:21.237570+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:32:21.237570+0000","last_undegraded":"2024-01-27T14:32:21.237570+0000","last_fullsized":"2024-01-27T14:32:21.237570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995622+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:32:32.995622+0000","last_peered":"2024-01-27T14:32:32.995622+0000","last_clean":"2024-01-27T14:32:32.995622+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:32:32.995622+0000","last_undegraded":"2024-01-27T14:32:32.995622+0000","last_fullsized":"2024-01-27T14:32:32.995622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294096+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:32:21.294096+0000","last_peered":"2024-01-27T14:32:21.294096+0000","last_clean":"2024-01-27T14:32:21.294096+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:32:21.294096+0000","last_undegraded":"2024-01-27T14:32:21.294096+0000","last_fullsized":"2024-01-27T14:32:21.294096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651865+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:32:21.651865+0000","last_peered":"2024-01-27T14:32:21.651865+0000","last_clean":"2024-01-27T14:32:21.651865+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:32:21.651865+0000","last_undegraded":"2024-01-27T14:32:21.651865+0000","last_fullsized":"2024-01-27T14:32:21.651865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.973448+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:32:25.973448+0000","last_peered":"2024-01-27T14:32:25.973448+0000","last_clean":"2024-01-27T14:32:25.973448+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:32:25.973448+0000","last_undegraded":"2024-01-27T14:32:25.973448+0000","last_fullsized":"2024-01-27T14:32:25.973448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295394+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:32:21.295394+0000","last_peered":"2024-01-27T14:32:21.295394+0000","last_clean":"2024-01-27T14:32:21.295394+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:32:21.295394+0000","last_undegraded":"2024-01-27T14:32:21.295394+0000","last_fullsized":"2024-01-27T14:32:21.295394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238196+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:32:21.238196+0000","last_peered":"2024-01-27T14:32:21.238196+0000","last_clean":"2024-01-27T14:32:21.238196+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:32:21.238196+0000","last_undegraded":"2024-01-27T14:32:21.238196+0000","last_fullsized":"2024-01-27T14:32:21.238196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.003239+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:32:33.003239+0000","last_peered":"2024-01-27T14:32:33.003239+0000","last_clean":"2024-01-27T14:32:33.003239+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:32:33.003239+0000","last_undegraded":"2024-01-27T14:32:33.003239+0000","last_fullsized":"2024-01-27T14:32:33.003239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294635+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:32:21.294635+0000","last_peered":"2024-01-27T14:32:21.294635+0000","last_clean":"2024-01-27T14:32:21.294635+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:32:21.294635+0000","last_undegraded":"2024-01-27T14:32:21.294635+0000","last_fullsized":"2024-01-27T14:32:21.294635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238451+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:32:21.238451+0000","last_peered":"2024-01-27T14:32:21.238451+0000","last_clean":"2024-01-27T14:32:21.238451+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:32:21.238451+0000","last_undegraded":"2024-01-27T14:32:21.238451+0000","last_fullsized":"2024-01-27T14:32:21.238451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'7","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.745276+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:32:30.745276+0000","last_peered":"2024-01-27T14:32:30.745276+0000","last_clean":"2024-01-27T14:32:30.745276+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:32:30.745276+0000","last_undegraded":"2024-01-27T14:32:30.745276+0000","last_fullsized":"2024-01-27T14:32:30.745276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237454+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:32:21.237454+0000","last_peered":"2024-01-27T14:32:21.237454+0000","last_clean":"2024-01-27T14:32:21.237454+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:32:21.237454+0000","last_undegraded":"2024-01-27T14:32:21.237454+0000","last_fullsized":"2024-01-27T14:32:21.237454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295251+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:32:21.295251+0000","last_peered":"2024-01-27T14:32:21.295251+0000","last_clean":"2024-01-27T14:32:21.295251+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:32:21.295251+0000","last_undegraded":"2024-01-27T14:32:21.295251+0000","last_fullsized":"2024-01-27T14:32:21.295251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.830740+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:32:30.830740+0000","last_peered":"2024-01-27T14:32:30.830740+0000","last_clean":"2024-01-27T14:32:30.830740+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:32:30.830740+0000","last_undegraded":"2024-01-27T14:32:30.830740+0000","last_fullsized":"2024-01-27T14:32:30.830740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294883+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:32:21.294883+0000","last_peered":"2024-01-27T14:32:21.294883+0000","last_clean":"2024-01-27T14:32:21.294883+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:32:21.294883+0000","last_undegraded":"2024-01-27T14:32:21.294883+0000","last_fullsized":"2024-01-27T14:32:21.294883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295239+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:32:21.295239+0000","last_peered":"2024-01-27T14:32:21.295239+0000","last_clean":"2024-01-27T14:32:21.295239+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:32:21.295239+0000","last_undegraded":"2024-01-27T14:32:21.295239+0000","last_fullsized":"2024-01-27T14:32:21.295239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651104+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:32:21.651104+0000","last_peered":"2024-01-27T14:32:21.651104+0000","last_clean":"2024-01-27T14:32:21.651104+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:32:21.651104+0000","last_undegraded":"2024-01-27T14:32:21.651104+0000","last_fullsized":"2024-01-27T14:32:21.651104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294731+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:32:21.294731+0000","last_peered":"2024-01-27T14:32:21.294731+0000","last_clean":"2024-01-27T14:32:21.294731+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:32:21.294731+0000","last_undegraded":"2024-01-27T14:32:21.294731+0000","last_fullsized":"2024-01-27T14:32:21.294731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652309+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:32:21.652309+0000","last_peered":"2024-01-27T14:32:21.652309+0000","last_clean":"2024-01-27T14:32:21.652309+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:32:21.652309+0000","last_undegraded":"2024-01-27T14:32:21.652309+0000","last_fullsized":"2024-01-27T14:32:21.652309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.006555+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:32:33.006555+0000","last_peered":"2024-01-27T14:32:33.006555+0000","last_clean":"2024-01-27T14:32:33.006555+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:32:33.006555+0000","last_undegraded":"2024-01-27T14:32:33.006555+0000","last_fullsized":"2024-01-27T14:32:33.006555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654208+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:32:21.654208+0000","last_peered":"2024-01-27T14:32:21.654208+0000","last_clean":"2024-01-27T14:32:21.654208+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:32:21.654208+0000","last_undegraded":"2024-01-27T14:32:21.654208+0000","last_fullsized":"2024-01-27T14:32:21.654208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650497+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:32:21.650497+0000","last_peered":"2024-01-27T14:32:21.650497+0000","last_clean":"2024-01-27T14:32:21.650497+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:32:21.650497+0000","last_undegraded":"2024-01-27T14:32:21.650497+0000","last_fullsized":"2024-01-27T14:32:21.650497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.349735+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:32:28.349735+0000","last_peered":"2024-01-27T14:32:28.349735+0000","last_clean":"2024-01-27T14:32:28.349735+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:32:28.349735+0000","last_undegraded":"2024-01-27T14:32:28.349735+0000","last_fullsized":"2024-01-27T14:32:28.349735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295213+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:32:21.295213+0000","last_peered":"2024-01-27T14:32:21.295213+0000","last_clean":"2024-01-27T14:32:21.295213+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:32:21.295213+0000","last_undegraded":"2024-01-27T14:32:21.295213+0000","last_fullsized":"2024-01-27T14:32:21.295213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294709+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:32:21.294709+0000","last_peered":"2024-01-27T14:32:21.294709+0000","last_clean":"2024-01-27T14:32:21.294709+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:32:21.294709+0000","last_undegraded":"2024-01-27T14:32:21.294709+0000","last_fullsized":"2024-01-27T14:32:21.294709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.319369+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:32:28.319369+0000","last_peered":"2024-01-27T14:32:28.319369+0000","last_clean":"2024-01-27T14:32:28.319369+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:32:28.319369+0000","last_undegraded":"2024-01-27T14:32:28.319369+0000","last_fullsized":"2024-01-27T14:32:28.319369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651175+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:32:21.651175+0000","last_peered":"2024-01-27T14:32:21.651175+0000","last_clean":"2024-01-27T14:32:21.651175+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:32:21.651175+0000","last_undegraded":"2024-01-27T14:32:21.651175+0000","last_fullsized":"2024-01-27T14:32:21.651175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237816+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:32:21.237816+0000","last_peered":"2024-01-27T14:32:21.237816+0000","last_clean":"2024-01-27T14:32:21.237816+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:32:21.237816+0000","last_undegraded":"2024-01-27T14:32:21.237816+0000","last_fullsized":"2024-01-27T14:32:21.237816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831029+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:32:30.831029+0000","last_peered":"2024-01-27T14:32:30.831029+0000","last_clean":"2024-01-27T14:32:30.831029+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:32:30.831029+0000","last_undegraded":"2024-01-27T14:32:30.831029+0000","last_fullsized":"2024-01-27T14:32:30.831029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241460+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:32:21.241460+0000","last_peered":"2024-01-27T14:32:21.241460+0000","last_clean":"2024-01-27T14:32:21.241460+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:32:21.241460+0000","last_undegraded":"2024-01-27T14:32:21.241460+0000","last_fullsized":"2024-01-27T14:32:21.241460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651549+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:32:21.651549+0000","last_peered":"2024-01-27T14:32:21.651549+0000","last_clean":"2024-01-27T14:32:21.651549+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:32:21.651549+0000","last_undegraded":"2024-01-27T14:32:21.651549+0000","last_fullsized":"2024-01-27T14:32:21.651549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651447+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:32:21.651447+0000","last_peered":"2024-01-27T14:32:21.651447+0000","last_clean":"2024-01-27T14:32:21.651447+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:32:21.651447+0000","last_undegraded":"2024-01-27T14:32:21.651447+0000","last_fullsized":"2024-01-27T14:32:21.651447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.738948+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:32:30.738948+0000","last_peered":"2024-01-27T14:32:30.738948+0000","last_clean":"2024-01-27T14:32:30.738948+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:32:30.738948+0000","last_undegraded":"2024-01-27T14:32:30.738948+0000","last_fullsized":"2024-01-27T14:32:30.738948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294745+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:32:21.294745+0000","last_peered":"2024-01-27T14:32:21.294745+0000","last_clean":"2024-01-27T14:32:21.294745+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:32:21.294745+0000","last_undegraded":"2024-01-27T14:32:21.294745+0000","last_fullsized":"2024-01-27T14:32:21.294745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652358+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:32:21.652358+0000","last_peered":"2024-01-27T14:32:21.652358+0000","last_clean":"2024-01-27T14:32:21.652358+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:32:21.652358+0000","last_undegraded":"2024-01-27T14:32:21.652358+0000","last_fullsized":"2024-01-27T14:32:21.652358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.863179+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:32:30.863179+0000","last_peered":"2024-01-27T14:32:30.863179+0000","last_clean":"2024-01-27T14:32:30.863179+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:32:30.863179+0000","last_undegraded":"2024-01-27T14:32:30.863179+0000","last_fullsized":"2024-01-27T14:32:30.863179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650897+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:32:21.650897+0000","last_peered":"2024-01-27T14:32:21.650897+0000","last_clean":"2024-01-27T14:32:21.650897+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:32:21.650897+0000","last_undegraded":"2024-01-27T14:32:21.650897+0000","last_fullsized":"2024-01-27T14:32:21.650897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652032+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:32:21.652032+0000","last_peered":"2024-01-27T14:32:21.652032+0000","last_clean":"2024-01-27T14:32:21.652032+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:32:21.652032+0000","last_undegraded":"2024-01-27T14:32:21.652032+0000","last_fullsized":"2024-01-27T14:32:21.652032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995877+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:32:32.995877+0000","last_peered":"2024-01-27T14:32:32.995877+0000","last_clean":"2024-01-27T14:32:32.995877+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:32:32.995877+0000","last_undegraded":"2024-01-27T14:32:32.995877+0000","last_fullsized":"2024-01-27T14:32:32.995877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651571+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:32:21.651571+0000","last_peered":"2024-01-27T14:32:21.651571+0000","last_clean":"2024-01-27T14:32:21.651571+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:32:21.651571+0000","last_undegraded":"2024-01-27T14:32:21.651571+0000","last_fullsized":"2024-01-27T14:32:21.651571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295584+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:32:21.295584+0000","last_peered":"2024-01-27T14:32:21.295584+0000","last_clean":"2024-01-27T14:32:21.295584+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:32:21.295584+0000","last_undegraded":"2024-01-27T14:32:21.295584+0000","last_fullsized":"2024-01-27T14:32:21.295584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652184+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:32:21.652184+0000","last_peered":"2024-01-27T14:32:21.652184+0000","last_clean":"2024-01-27T14:32:21.652184+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:32:21.652184+0000","last_undegraded":"2024-01-27T14:32:21.652184+0000","last_fullsized":"2024-01-27T14:32:21.652184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241389+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:32:21.241389+0000","last_peered":"2024-01-27T14:32:21.241389+0000","last_clean":"2024-01-27T14:32:21.241389+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:32:21.241389+0000","last_undegraded":"2024-01-27T14:32:21.241389+0000","last_fullsized":"2024-01-27T14:32:21.241389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651770+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:32:21.651770+0000","last_peered":"2024-01-27T14:32:21.651770+0000","last_clean":"2024-01-27T14:32:21.651770+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:32:21.651770+0000","last_undegraded":"2024-01-27T14:32:21.651770+0000","last_fullsized":"2024-01-27T14:32:21.651770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.747562+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:32:30.747562+0000","last_peered":"2024-01-27T14:32:30.747562+0000","last_clean":"2024-01-27T14:32:30.747562+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:32:30.747562+0000","last_undegraded":"2024-01-27T14:32:30.747562+0000","last_fullsized":"2024-01-27T14:32:30.747562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651327+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:32:21.651327+0000","last_peered":"2024-01-27T14:32:21.651327+0000","last_clean":"2024-01-27T14:32:21.651327+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:32:21.651327+0000","last_undegraded":"2024-01-27T14:32:21.651327+0000","last_fullsized":"2024-01-27T14:32:21.651327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241363+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:32:21.241363+0000","last_peered":"2024-01-27T14:32:21.241363+0000","last_clean":"2024-01-27T14:32:21.241363+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:32:21.241363+0000","last_undegraded":"2024-01-27T14:32:21.241363+0000","last_fullsized":"2024-01-27T14:32:21.241363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.862077+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:32:30.862077+0000","last_peered":"2024-01-27T14:32:30.862077+0000","last_clean":"2024-01-27T14:32:30.862077+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:32:30.862077+0000","last_undegraded":"2024-01-27T14:32:30.862077+0000","last_fullsized":"2024-01-27T14:32:30.862077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651305+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:32:21.651305+0000","last_peered":"2024-01-27T14:32:21.651305+0000","last_clean":"2024-01-27T14:32:21.651305+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:32:21.651305+0000","last_undegraded":"2024-01-27T14:32:21.651305+0000","last_fullsized":"2024-01-27T14:32:21.651305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652240+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:32:21.652240+0000","last_peered":"2024-01-27T14:32:21.652240+0000","last_clean":"2024-01-27T14:32:21.652240+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:32:21.652240+0000","last_undegraded":"2024-01-27T14:32:21.652240+0000","last_fullsized":"2024-01-27T14:32:21.652240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831231+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:32:30.831231+0000","last_peered":"2024-01-27T14:32:30.831231+0000","last_clean":"2024-01-27T14:32:30.831231+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:32:30.831231+0000","last_undegraded":"2024-01-27T14:32:30.831231+0000","last_fullsized":"2024-01-27T14:32:30.831231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294990+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:32:21.294990+0000","last_peered":"2024-01-27T14:32:21.294990+0000","last_clean":"2024-01-27T14:32:21.294990+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:32:21.294990+0000","last_undegraded":"2024-01-27T14:32:21.294990+0000","last_fullsized":"2024-01-27T14:32:21.294990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294975+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:32:21.294975+0000","last_peered":"2024-01-27T14:32:21.294975+0000","last_clean":"2024-01-27T14:32:21.294975+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.294975+0000","last_undegraded":"2024-01-27T14:32:21.294975+0000","last_fullsized":"2024-01-27T14:32:21.294975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.003237+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:32:33.003237+0000","last_peered":"2024-01-27T14:32:33.003237+0000","last_clean":"2024-01-27T14:32:33.003237+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:32:33.003237+0000","last_undegraded":"2024-01-27T14:32:33.003237+0000","last_fullsized":"2024-01-27T14:32:33.003237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.655214+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:32:21.655214+0000","last_peered":"2024-01-27T14:32:21.655214+0000","last_clean":"2024-01-27T14:32:21.655214+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:32:21.655214+0000","last_undegraded":"2024-01-27T14:32:21.655214+0000","last_fullsized":"2024-01-27T14:32:21.655214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652753+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:32:21.652753+0000","last_peered":"2024-01-27T14:32:21.652753+0000","last_clean":"2024-01-27T14:32:21.652753+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:32:21.652753+0000","last_undegraded":"2024-01-27T14:32:21.652753+0000","last_fullsized":"2024-01-27T14:32:21.652753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.006514+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:32:33.006514+0000","last_peered":"2024-01-27T14:32:33.006514+0000","last_clean":"2024-01-27T14:32:33.006514+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:32:33.006514+0000","last_undegraded":"2024-01-27T14:32:33.006514+0000","last_fullsized":"2024-01-27T14:32:33.006514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237928+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:32:21.237928+0000","last_peered":"2024-01-27T14:32:21.237928+0000","last_clean":"2024-01-27T14:32:21.237928+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:32:21.237928+0000","last_undegraded":"2024-01-27T14:32:21.237928+0000","last_fullsized":"2024-01-27T14:32:21.237928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651594+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:32:21.651594+0000","last_peered":"2024-01-27T14:32:21.651594+0000","last_clean":"2024-01-27T14:32:21.651594+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:32:21.651594+0000","last_undegraded":"2024-01-27T14:32:21.651594+0000","last_fullsized":"2024-01-27T14:32:21.651594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.876465+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:32:25.876465+0000","last_peered":"2024-01-27T14:32:25.876465+0000","last_clean":"2024-01-27T14:32:25.876465+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:32:25.876465+0000","last_undegraded":"2024-01-27T14:32:25.876465+0000","last_fullsized":"2024-01-27T14:32:25.876465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294920+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:32:21.294920+0000","last_peered":"2024-01-27T14:32:21.294920+0000","last_clean":"2024-01-27T14:32:21.294920+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:32:21.294920+0000","last_undegraded":"2024-01-27T14:32:21.294920+0000","last_fullsized":"2024-01-27T14:32:21.294920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651487+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:32:21.651487+0000","last_peered":"2024-01-27T14:32:21.651487+0000","last_clean":"2024-01-27T14:32:21.651487+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:32:21.651487+0000","last_undegraded":"2024-01-27T14:32:21.651487+0000","last_fullsized":"2024-01-27T14:32:21.651487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.910631+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:32:32.910631+0000","last_peered":"2024-01-27T14:32:32.910631+0000","last_clean":"2024-01-27T14:32:32.910631+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:32:32.910631+0000","last_undegraded":"2024-01-27T14:32:32.910631+0000","last_fullsized":"2024-01-27T14:32:32.910631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292926+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:32:21.292926+0000","last_peered":"2024-01-27T14:32:21.292926+0000","last_clean":"2024-01-27T14:32:21.292926+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:32:21.292926+0000","last_undegraded":"2024-01-27T14:32:21.292926+0000","last_fullsized":"2024-01-27T14:32:21.292926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295496+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:32:21.295496+0000","last_peered":"2024-01-27T14:32:21.295496+0000","last_clean":"2024-01-27T14:32:21.295496+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:32:21.295496+0000","last_undegraded":"2024-01-27T14:32:21.295496+0000","last_fullsized":"2024-01-27T14:32:21.295496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.972769+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:32:25.972769+0000","last_peered":"2024-01-27T14:32:25.972769+0000","last_clean":"2024-01-27T14:32:25.972769+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:32:25.972769+0000","last_undegraded":"2024-01-27T14:32:25.972769+0000","last_fullsized":"2024-01-27T14:32:25.972769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237746+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:32:21.237746+0000","last_peered":"2024-01-27T14:32:21.237746+0000","last_clean":"2024-01-27T14:32:21.237746+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:32:21.237746+0000","last_undegraded":"2024-01-27T14:32:21.237746+0000","last_fullsized":"2024-01-27T14:32:21.237746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654246+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:32:21.654246+0000","last_peered":"2024-01-27T14:32:21.654246+0000","last_clean":"2024-01-27T14:32:21.654246+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:32:21.654246+0000","last_undegraded":"2024-01-27T14:32:21.654246+0000","last_fullsized":"2024-01-27T14:32:21.654246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237784+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:32:21.237784+0000","last_peered":"2024-01-27T14:32:21.237784+0000","last_clean":"2024-01-27T14:32:21.237784+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:32:21.237784+0000","last_undegraded":"2024-01-27T14:32:21.237784+0000","last_fullsized":"2024-01-27T14:32:21.237784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.830902+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:32:30.830902+0000","last_peered":"2024-01-27T14:32:30.830902+0000","last_clean":"2024-01-27T14:32:30.830902+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:32:30.830902+0000","last_undegraded":"2024-01-27T14:32:30.830902+0000","last_fullsized":"2024-01-27T14:32:30.830902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652002+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:32:21.652002+0000","last_peered":"2024-01-27T14:32:21.652002+0000","last_clean":"2024-01-27T14:32:21.652002+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:32:21.652002+0000","last_undegraded":"2024-01-27T14:32:21.652002+0000","last_fullsized":"2024-01-27T14:32:21.652002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650619+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:32:21.650619+0000","last_peered":"2024-01-27T14:32:21.650619+0000","last_clean":"2024-01-27T14:32:21.650619+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:32:21.650619+0000","last_undegraded":"2024-01-27T14:32:21.650619+0000","last_fullsized":"2024-01-27T14:32:21.650619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.298175+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:32:28.298175+0000","last_peered":"2024-01-27T14:32:28.298175+0000","last_clean":"2024-01-27T14:32:28.298175+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:32:28.298175+0000","last_undegraded":"2024-01-27T14:32:28.298175+0000","last_fullsized":"2024-01-27T14:32:28.298175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831042+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:32:30.831042+0000","last_peered":"2024-01-27T14:32:30.831042+0000","last_clean":"2024-01-27T14:32:30.831042+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:32:30.831042+0000","last_undegraded":"2024-01-27T14:32:30.831042+0000","last_fullsized":"2024-01-27T14:32:30.831042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237832+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:32:21.237832+0000","last_peered":"2024-01-27T14:32:21.237832+0000","last_clean":"2024-01-27T14:32:21.237832+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:32:21.237832+0000","last_undegraded":"2024-01-27T14:32:21.237832+0000","last_fullsized":"2024-01-27T14:32:21.237832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237968+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:32:21.237968+0000","last_peered":"2024-01-27T14:32:21.237968+0000","last_clean":"2024-01-27T14:32:21.237968+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:32:21.237968+0000","last_undegraded":"2024-01-27T14:32:21.237968+0000","last_fullsized":"2024-01-27T14:32:21.237968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.955129+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:32:25.955129+0000","last_peered":"2024-01-27T14:32:25.955129+0000","last_clean":"2024-01-27T14:32:25.955129+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:32:25.955129+0000","last_undegraded":"2024-01-27T14:32:25.955129+0000","last_fullsized":"2024-01-27T14:32:25.955129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241561+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:32:21.241561+0000","last_peered":"2024-01-27T14:32:21.241561+0000","last_clean":"2024-01-27T14:32:21.241561+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:32:21.241561+0000","last_undegraded":"2024-01-27T14:32:21.241561+0000","last_fullsized":"2024-01-27T14:32:21.241561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293607+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:32:21.293607+0000","last_peered":"2024-01-27T14:32:21.293607+0000","last_clean":"2024-01-27T14:32:21.293607+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:32:21.293607+0000","last_undegraded":"2024-01-27T14:32:21.293607+0000","last_fullsized":"2024-01-27T14:32:21.293607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294584+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:32:21.294584+0000","last_peered":"2024-01-27T14:32:21.294584+0000","last_clean":"2024-01-27T14:32:21.294584+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:32:21.294584+0000","last_undegraded":"2024-01-27T14:32:21.294584+0000","last_fullsized":"2024-01-27T14:32:21.294584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293063+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:32:21.293063+0000","last_peered":"2024-01-27T14:32:21.293063+0000","last_clean":"2024-01-27T14:32:21.293063+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:32:21.293063+0000","last_undegraded":"2024-01-27T14:32:21.293063+0000","last_fullsized":"2024-01-27T14:32:21.293063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651459+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:32:21.651459+0000","last_peered":"2024-01-27T14:32:21.651459+0000","last_clean":"2024-01-27T14:32:21.651459+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:32:21.651459+0000","last_undegraded":"2024-01-27T14:32:21.651459+0000","last_fullsized":"2024-01-27T14:32:21.651459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650996+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:32:21.650996+0000","last_peered":"2024-01-27T14:32:21.650996+0000","last_clean":"2024-01-27T14:32:21.650996+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:32:21.650996+0000","last_undegraded":"2024-01-27T14:32:21.650996+0000","last_fullsized":"2024-01-27T14:32:21.650996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295167+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:32:21.295167+0000","last_peered":"2024-01-27T14:32:21.295167+0000","last_clean":"2024-01-27T14:32:21.295167+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:32:21.295167+0000","last_undegraded":"2024-01-27T14:32:21.295167+0000","last_fullsized":"2024-01-27T14:32:21.295167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295361+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:32:21.295361+0000","last_peered":"2024-01-27T14:32:21.295361+0000","last_clean":"2024-01-27T14:32:21.295361+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:32:21.295361+0000","last_undegraded":"2024-01-27T14:32:21.295361+0000","last_fullsized":"2024-01-27T14:32:21.295361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295399+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:32:21.295399+0000","last_peered":"2024-01-27T14:32:21.295399+0000","last_clean":"2024-01-27T14:32:21.295399+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:32:21.295399+0000","last_undegraded":"2024-01-27T14:32:21.295399+0000","last_fullsized":"2024-01-27T14:32:21.295399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651227+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:32:21.651227+0000","last_peered":"2024-01-27T14:32:21.651227+0000","last_clean":"2024-01-27T14:32:21.651227+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:32:21.651227+0000","last_undegraded":"2024-01-27T14:32:21.651227+0000","last_fullsized":"2024-01-27T14:32:21.651227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651809+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:32:21.651809+0000","last_peered":"2024-01-27T14:32:21.651809+0000","last_clean":"2024-01-27T14:32:21.651809+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:32:21.651809+0000","last_undegraded":"2024-01-27T14:32:21.651809+0000","last_fullsized":"2024-01-27T14:32:21.651809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650583+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:32:21.650583+0000","last_peered":"2024-01-27T14:32:21.650583+0000","last_clean":"2024-01-27T14:32:21.650583+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:32:21.650583+0000","last_undegraded":"2024-01-27T14:32:21.650583+0000","last_fullsized":"2024-01-27T14:32:21.650583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241509+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:32:21.241509+0000","last_peered":"2024-01-27T14:32:21.241509+0000","last_clean":"2024-01-27T14:32:21.241509+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.241509+0000","last_undegraded":"2024-01-27T14:32:21.241509+0000","last_fullsized":"2024-01-27T14:32:21.241509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237731+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:32:21.237731+0000","last_peered":"2024-01-27T14:32:21.237731+0000","last_clean":"2024-01-27T14:32:21.237731+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:32:21.237731+0000","last_undegraded":"2024-01-27T14:32:21.237731+0000","last_fullsized":"2024-01-27T14:32:21.237731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652272+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:32:21.652272+0000","last_peered":"2024-01-27T14:32:21.652272+0000","last_clean":"2024-01-27T14:32:21.652272+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:32:21.652272+0000","last_undegraded":"2024-01-27T14:32:21.652272+0000","last_fullsized":"2024-01-27T14:32:21.652272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651644+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:32:21.651644+0000","last_peered":"2024-01-27T14:32:21.651644+0000","last_clean":"2024-01-27T14:32:21.651644+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:32:21.651644+0000","last_undegraded":"2024-01-27T14:32:21.651644+0000","last_fullsized":"2024-01-27T14:32:21.651644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293934+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:32:21.293934+0000","last_peered":"2024-01-27T14:32:21.293934+0000","last_clean":"2024-01-27T14:32:21.293934+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:32:21.293934+0000","last_undegraded":"2024-01-27T14:32:21.293934+0000","last_fullsized":"2024-01-27T14:32:21.293934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652172+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:32:21.652172+0000","last_peered":"2024-01-27T14:32:21.652172+0000","last_clean":"2024-01-27T14:32:21.652172+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:32:21.652172+0000","last_undegraded":"2024-01-27T14:32:21.652172+0000","last_fullsized":"2024-01-27T14:32:21.652172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651716+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:32:21.651716+0000","last_peered":"2024-01-27T14:32:21.651716+0000","last_clean":"2024-01-27T14:32:21.651716+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:32:21.651716+0000","last_undegraded":"2024-01-27T14:32:21.651716+0000","last_fullsized":"2024-01-27T14:32:21.651716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650693+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:32:21.650693+0000","last_peered":"2024-01-27T14:32:21.650693+0000","last_clean":"2024-01-27T14:32:21.650693+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:32:21.650693+0000","last_undegraded":"2024-01-27T14:32:21.650693+0000","last_fullsized":"2024-01-27T14:32:21.650693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294879+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:32:21.294879+0000","last_peered":"2024-01-27T14:32:21.294879+0000","last_clean":"2024-01-27T14:32:21.294879+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:32:21.294879+0000","last_undegraded":"2024-01-27T14:32:21.294879+0000","last_fullsized":"2024-01-27T14:32:21.294879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295073+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:32:21.295073+0000","last_peered":"2024-01-27T14:32:21.295073+0000","last_clean":"2024-01-27T14:32:21.295073+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:32:21.295073+0000","last_undegraded":"2024-01-27T14:32:21.295073+0000","last_fullsized":"2024-01-27T14:32:21.295073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652186+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:32:21.652186+0000","last_peered":"2024-01-27T14:32:21.652186+0000","last_clean":"2024-01-27T14:32:21.652186+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:32:21.652186+0000","last_undegraded":"2024-01-27T14:32:21.652186+0000","last_fullsized":"2024-01-27T14:32:21.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652698+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:32:21.652698+0000","last_peered":"2024-01-27T14:32:21.652698+0000","last_clean":"2024-01-27T14:32:21.652698+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:32:21.652698+0000","last_undegraded":"2024-01-27T14:32:21.652698+0000","last_fullsized":"2024-01-27T14:32:21.652698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652572+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:32:21.652572+0000","last_peered":"2024-01-27T14:32:21.652572+0000","last_clean":"2024-01-27T14:32:21.652572+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:32:21.652572+0000","last_undegraded":"2024-01-27T14:32:21.652572+0000","last_fullsized":"2024-01-27T14:32:21.652572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241969+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:32:21.241969+0000","last_peered":"2024-01-27T14:32:21.241969+0000","last_clean":"2024-01-27T14:32:21.241969+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:32:21.241969+0000","last_undegraded":"2024-01-27T14:32:21.241969+0000","last_fullsized":"2024-01-27T14:32:21.241969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650428+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:32:21.650428+0000","last_peered":"2024-01-27T14:32:21.650428+0000","last_clean":"2024-01-27T14:32:21.650428+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:32:21.650428+0000","last_undegraded":"2024-01-27T14:32:21.650428+0000","last_fullsized":"2024-01-27T14:32:21.650428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651824+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:32:21.651824+0000","last_peered":"2024-01-27T14:32:21.651824+0000","last_clean":"2024-01-27T14:32:21.651824+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:32:21.651824+0000","last_undegraded":"2024-01-27T14:32:21.651824+0000","last_fullsized":"2024-01-27T14:32:21.651824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294824+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:32:21.294824+0000","last_peered":"2024-01-27T14:32:21.294824+0000","last_clean":"2024-01-27T14:32:21.294824+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:32:21.294824+0000","last_undegraded":"2024-01-27T14:32:21.294824+0000","last_fullsized":"2024-01-27T14:32:21.294824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654122+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:32:21.654122+0000","last_peered":"2024-01-27T14:32:21.654122+0000","last_clean":"2024-01-27T14:32:21.654122+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:32:21.654122+0000","last_undegraded":"2024-01-27T14:32:21.654122+0000","last_fullsized":"2024-01-27T14:32:21.654122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294919+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:32:21.294919+0000","last_peered":"2024-01-27T14:32:21.294919+0000","last_clean":"2024-01-27T14:32:21.294919+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:32:21.294919+0000","last_undegraded":"2024-01-27T14:32:21.294919+0000","last_fullsized":"2024-01-27T14:32:21.294919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651126+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:32:21.651126+0000","last_peered":"2024-01-27T14:32:21.651126+0000","last_clean":"2024-01-27T14:32:21.651126+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:32:21.651126+0000","last_undegraded":"2024-01-27T14:32:21.651126+0000","last_fullsized":"2024-01-27T14:32:21.651126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651251+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:32:21.651251+0000","last_peered":"2024-01-27T14:32:21.651251+0000","last_clean":"2024-01-27T14:32:21.651251+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:32:21.651251+0000","last_undegraded":"2024-01-27T14:32:21.651251+0000","last_fullsized":"2024-01-27T14:32:21.651251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651939+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:32:21.651939+0000","last_peered":"2024-01-27T14:32:21.651939+0000","last_clean":"2024-01-27T14:32:21.651939+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:32:21.651939+0000","last_undegraded":"2024-01-27T14:32:21.651939+0000","last_fullsized":"2024-01-27T14:32:21.651939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10263,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":126159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":716299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.433}]},{"osd":1,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.317},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.379},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.36799999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.35599999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":127827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":1.073},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":1.097},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.95299999999999996}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":1.022}]},{"osd":5,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.0469999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":129014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.66600000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.872},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47199999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":921600,"data_stored":716887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.374}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53400000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":127647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.217},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.315}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.439}]},{"osd":5,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.373},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":127485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":130604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:32:35.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:32:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.022+0000 7f09b5aec640 1 Processor -- start 2024-01-27T14:32:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.022+0000 7f09b5aec640 1 -- start start 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.023+0000 7f09b5aec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09b00c9210 0x7f09b00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.023+0000 7f09b5aec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09b015a110 0x7f09b015a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.023+0000 7f09b5aec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00cad80 con 0x7f09b00cf0e0 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.023+0000 7f09b5aec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00b4c80 con 0x7f09b015a110 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.023+0000 7f09b5aec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b01599e0 con 0x7f09b00c9210 2024-01-27T14:32:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.024+0000 7f09aeffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09b015a110 0x7f09b015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.024+0000 7f09aeffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f09b015a110 0x7f09b015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35482/0 (socket says 172.21.15.46:35482) 2024-01-27T14:32:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.024+0000 7f09aeffd640 1 -- 172.21.15.46:0/3201959714 learned_addr learned my addr 172.21.15.46:0/3201959714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.025+0000 7f09af7fe640 1 --2- 172.21.15.46:0/3201959714 >> v2:172.21.15.73:3300/0 conn(0x7f09b00c9210 0x7f09b00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.027+0000 7f09aeffd640 1 -- 172.21.15.46:0/3201959714 >> v2:172.21.15.73:3300/0 conn(0x7f09b00c9210 msgr2=0x7f09b00ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.027+0000 7f09aeffd640 1 --2- 172.21.15.46:0/3201959714 >> v2:172.21.15.73:3300/0 conn(0x7f09b00c9210 0x7f09b00ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.027+0000 7f09aeffd640 1 -- 172.21.15.46:0/3201959714 >> v1:172.21.15.73:6789/0 conn(0x7f09b00cf0e0 legacy=0x7f09b00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.027+0000 7f09aeffd640 1 -- 172.21.15.46:0/3201959714 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b015df00 con 0x7f09b015a110 2024-01-27T14:32:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.029+0000 7f09aeffd640 1 --2- 172.21.15.46:0/3201959714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b015a110 0x7f09b015a550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09b008d170 tx=0x7f09a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8824151cd13e06ed server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09ae7fc640 1 -- 172.21.15.46:0/3201959714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031870 con 0x7f09b015a110 2024-01-27T14:32:36.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09ae7fc640 1 -- 172.21.15.46:0/3201959714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a00319d0 con 0x7f09b015a110 2024-01-27T14:32:36.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09ae7fc640 1 -- 172.21.15.46:0/3201959714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031d60 con 0x7f09b015a110 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 -- 172.21.15.46:0/3201959714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b015a110 msgr2=0x7f09b015a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 --2- 172.21.15.46:0/3201959714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b015a110 0x7f09b015a550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09b008d170 tx=0x7f09a002b910 comp rx=0 tx=0).stop 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 -- 172.21.15.46:0/3201959714 shutdown_connections 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 --2- 172.21.15.46:0/3201959714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b015a110 0x7f09b015a550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 --2- 172.21.15.46:0/3201959714 >> v2:172.21.15.73:3300/0 conn(0x7f09b00c9210 0x7f09b00ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 -- 172.21.15.46:0/3201959714 >> 172.21.15.46:0/3201959714 conn(0x7f09b00668b0 msgr2=0x7f09b006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:36.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 -- 172.21.15.46:0/3201959714 shutdown_connections 2024-01-27T14:32:36.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.034+0000 7f09b5aec640 1 -- 172.21.15.46:0/3201959714 wait complete. 2024-01-27T14:32:36.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.036+0000 7f09b5aec640 1 Processor -- start 2024-01-27T14:32:36.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.036+0000 7f09b5aec640 1 -- start start 2024-01-27T14:32:36.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.036+0000 7f09b5aec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09b00c9210 0x7f09b01eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09b5aec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09b5aec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 0x7f09b0153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09b5aec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c48e0 con 0x7f09b00cf0e0 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09b5aec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c5570 con 0x7f09b015a110 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09b5aec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c4aa0 con 0x7f09b00c9210 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35498/0 (socket says 172.21.15.46:35498) 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09aeffd640 1 -- 172.21.15.46:0/183975964 learned_addr learned my addr 172.21.15.46:0/183975964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09af7fe640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09b00c9210 0x7f09b01eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.037+0000 7f09affff640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 0x7f09b0153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09aeffd640 1 -- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09b00c9210 msgr2=0x7f09b01eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09aeffd640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09b00c9210 0x7f09b01eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09aeffd640 1 -- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 msgr2=0x7f09b0153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09aeffd640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 0x7f09b0153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09aeffd640 1 -- 172.21.15.46:0/183975964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00094d0 con 0x7f09b00cf0e0 2024-01-27T14:32:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.041+0000 7f09affff640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 0x7f09b0153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:36.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.043+0000 7f09aeffd640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09a00090b0 tx=0x7f09a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.047+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a003ac60 con 0x7f09b00cf0e0 2024-01-27T14:32:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.047+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a003adc0 con 0x7f09b00cf0e0 2024-01-27T14:32:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.047+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0044630 con 0x7f09b00cf0e0 2024-01-27T14:32:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.047+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b00c43b0 con 0x7f09b00cf0e0 2024-01-27T14:32:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.047+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b00c4600 con 0x7f09b00cf0e0 2024-01-27T14:32:36.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.048+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b00742e0 con 0x7f09b00cf0e0 2024-01-27T14:32:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.080+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f09a0044790 con 0x7f09b00cf0e0 2024-01-27T14:32:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.080+0000 7f0997fff640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 0x7f099c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.080+0000 7f09af7fe640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 0x7f099c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.081+0000 7f09af7fe640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 0x7f099c06d410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006fd0 tx=0x7f09a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.342+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f09a002d040 con 0x7f09b00cf0e0 2024-01-27T14:32:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.342+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f09a0077040 con 0x7f09b00cf0e0 2024-01-27T14:32:36.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.523+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b015d660 con 0x7f099c06af50 2024-01-27T14:32:36.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.533+0000 7f0997fff640 1 -- 172.21.15.46:0/183975964 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364827 (secure 0 0 0) 0x7f09a4010990 con 0x7f099c06af50 2024-01-27T14:32:36.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:36.536 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 msgr2=0x7f099c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 0x7f099c06d410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006fd0 tx=0x7f09a4008040 comp rx=0 tx=0).stop 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 msgr2=0x7f09b0156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09a00090b0 tx=0x7f09a00046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 shutdown_connections 2024-01-27T14:32:36.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f099c06af50 0x7f099c06d410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09b015a110 0x7f09b0153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09b00cf0e0 0x7f09b0156770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 --2- 172.21.15.46:0/183975964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09b00c9210 0x7f09b01eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 >> 172.21.15.46:0/183975964 conn(0x7f09b00668b0 msgr2=0x7f09b0158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 shutdown_connections 2024-01-27T14:32:36.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.537+0000 7f09b5aec640 1 -- 172.21.15.46:0/183975964 wait complete. 2024-01-27T14:32:36.545 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-01-27T14:32:35.011318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600631,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":366,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236576,"kb_used_data":3808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738144,"statfs":{"total":773094113280,"available":772851859456,"internally_reserved":0,"allocated":3899392,"data_stored":2201922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004180"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995878+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:32:32.995878+0000","last_peered":"2024-01-27T14:32:32.995878+0000","last_clean":"2024-01-27T14:32:32.995878+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:32:32.995878+0000","last_undegraded":"2024-01-27T14:32:32.995878+0000","last_fullsized":"2024-01-27T14:32:32.995878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651376+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:32:21.651376+0000","last_peered":"2024-01-27T14:32:21.651376+0000","last_clean":"2024-01-27T14:32:21.651376+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:32:21.651376+0000","last_undegraded":"2024-01-27T14:32:21.651376+0000","last_fullsized":"2024-01-27T14:32:21.651376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292974+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:32:21.292974+0000","last_peered":"2024-01-27T14:32:21.292974+0000","last_clean":"2024-01-27T14:32:21.292974+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:32:21.292974+0000","last_undegraded":"2024-01-27T14:32:21.292974+0000","last_fullsized":"2024-01-27T14:32:21.292974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651507+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:32:21.651507+0000","last_peered":"2024-01-27T14:32:21.651507+0000","last_clean":"2024-01-27T14:32:21.651507+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:32:21.651507+0000","last_undegraded":"2024-01-27T14:32:21.651507+0000","last_fullsized":"2024-01-27T14:32:21.651507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651384+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:32:21.651384+0000","last_peered":"2024-01-27T14:32:21.651384+0000","last_clean":"2024-01-27T14:32:21.651384+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:32:21.651384+0000","last_undegraded":"2024-01-27T14:32:21.651384+0000","last_fullsized":"2024-01-27T14:32:21.651384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294582+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:32:21.294582+0000","last_peered":"2024-01-27T14:32:21.294582+0000","last_clean":"2024-01-27T14:32:21.294582+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:32:21.294582+0000","last_undegraded":"2024-01-27T14:32:21.294582+0000","last_fullsized":"2024-01-27T14:32:21.294582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.912349+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:32:32.912349+0000","last_peered":"2024-01-27T14:32:32.912349+0000","last_clean":"2024-01-27T14:32:32.912349+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:32:32.912349+0000","last_undegraded":"2024-01-27T14:32:32.912349+0000","last_fullsized":"2024-01-27T14:32:32.912349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241636+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:32:21.241636+0000","last_peered":"2024-01-27T14:32:21.241636+0000","last_clean":"2024-01-27T14:32:21.241636+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:32:21.241636+0000","last_undegraded":"2024-01-27T14:32:21.241636+0000","last_fullsized":"2024-01-27T14:32:21.241636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294900+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:32:21.294900+0000","last_peered":"2024-01-27T14:32:21.294900+0000","last_clean":"2024-01-27T14:32:21.294900+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:32:21.294900+0000","last_undegraded":"2024-01-27T14:32:21.294900+0000","last_fullsized":"2024-01-27T14:32:21.294900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.911741+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:32:32.911741+0000","last_peered":"2024-01-27T14:32:32.911741+0000","last_clean":"2024-01-27T14:32:32.911741+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:32:32.911741+0000","last_undegraded":"2024-01-27T14:32:32.911741+0000","last_fullsized":"2024-01-27T14:32:32.911741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652524+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:32:21.652524+0000","last_peered":"2024-01-27T14:32:21.652524+0000","last_clean":"2024-01-27T14:32:21.652524+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:32:21.652524+0000","last_undegraded":"2024-01-27T14:32:21.652524+0000","last_fullsized":"2024-01-27T14:32:21.652524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294671+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:32:21.294671+0000","last_peered":"2024-01-27T14:32:21.294671+0000","last_clean":"2024-01-27T14:32:21.294671+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:32:21.294671+0000","last_undegraded":"2024-01-27T14:32:21.294671+0000","last_fullsized":"2024-01-27T14:32:21.294671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651544+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:32:21.651544+0000","last_peered":"2024-01-27T14:32:21.651544+0000","last_clean":"2024-01-27T14:32:21.651544+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:32:21.651544+0000","last_undegraded":"2024-01-27T14:32:21.651544+0000","last_fullsized":"2024-01-27T14:32:21.651544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.868776+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:32:25.868776+0000","last_peered":"2024-01-27T14:32:25.868776+0000","last_clean":"2024-01-27T14:32:25.868776+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:32:25.868776+0000","last_undegraded":"2024-01-27T14:32:25.868776+0000","last_fullsized":"2024-01-27T14:32:25.868776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651027+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:32:21.651027+0000","last_peered":"2024-01-27T14:32:21.651027+0000","last_clean":"2024-01-27T14:32:21.651027+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:32:21.651027+0000","last_undegraded":"2024-01-27T14:32:21.651027+0000","last_fullsized":"2024-01-27T14:32:21.651027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293539+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:32:21.293539+0000","last_peered":"2024-01-27T14:32:21.293539+0000","last_clean":"2024-01-27T14:32:21.293539+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:32:21.293539+0000","last_undegraded":"2024-01-27T14:32:21.293539+0000","last_fullsized":"2024-01-27T14:32:21.293539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.011132+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:32:28.011132+0000","last_peered":"2024-01-27T14:32:28.011132+0000","last_clean":"2024-01-27T14:32:28.011132+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:32:28.011132+0000","last_undegraded":"2024-01-27T14:32:28.011132+0000","last_fullsized":"2024-01-27T14:32:28.011132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651904+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:32:21.651904+0000","last_peered":"2024-01-27T14:32:21.651904+0000","last_clean":"2024-01-27T14:32:21.651904+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:32:21.651904+0000","last_undegraded":"2024-01-27T14:32:21.651904+0000","last_fullsized":"2024-01-27T14:32:21.651904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237570+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:32:21.237570+0000","last_peered":"2024-01-27T14:32:21.237570+0000","last_clean":"2024-01-27T14:32:21.237570+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:32:21.237570+0000","last_undegraded":"2024-01-27T14:32:21.237570+0000","last_fullsized":"2024-01-27T14:32:21.237570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995622+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:32:32.995622+0000","last_peered":"2024-01-27T14:32:32.995622+0000","last_clean":"2024-01-27T14:32:32.995622+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:32:32.995622+0000","last_undegraded":"2024-01-27T14:32:32.995622+0000","last_fullsized":"2024-01-27T14:32:32.995622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294096+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:32:21.294096+0000","last_peered":"2024-01-27T14:32:21.294096+0000","last_clean":"2024-01-27T14:32:21.294096+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:32:21.294096+0000","last_undegraded":"2024-01-27T14:32:21.294096+0000","last_fullsized":"2024-01-27T14:32:21.294096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651865+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:32:21.651865+0000","last_peered":"2024-01-27T14:32:21.651865+0000","last_clean":"2024-01-27T14:32:21.651865+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:32:21.651865+0000","last_undegraded":"2024-01-27T14:32:21.651865+0000","last_fullsized":"2024-01-27T14:32:21.651865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.973448+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:32:25.973448+0000","last_peered":"2024-01-27T14:32:25.973448+0000","last_clean":"2024-01-27T14:32:25.973448+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:32:25.973448+0000","last_undegraded":"2024-01-27T14:32:25.973448+0000","last_fullsized":"2024-01-27T14:32:25.973448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295394+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:32:21.295394+0000","last_peered":"2024-01-27T14:32:21.295394+0000","last_clean":"2024-01-27T14:32:21.295394+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:32:21.295394+0000","last_undegraded":"2024-01-27T14:32:21.295394+0000","last_fullsized":"2024-01-27T14:32:21.295394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238196+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:32:21.238196+0000","last_peered":"2024-01-27T14:32:21.238196+0000","last_clean":"2024-01-27T14:32:21.238196+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:32:21.238196+0000","last_undegraded":"2024-01-27T14:32:21.238196+0000","last_fullsized":"2024-01-27T14:32:21.238196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.003239+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:32:33.003239+0000","last_peered":"2024-01-27T14:32:33.003239+0000","last_clean":"2024-01-27T14:32:33.003239+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:32:33.003239+0000","last_undegraded":"2024-01-27T14:32:33.003239+0000","last_fullsized":"2024-01-27T14:32:33.003239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294635+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:32:21.294635+0000","last_peered":"2024-01-27T14:32:21.294635+0000","last_clean":"2024-01-27T14:32:21.294635+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:32:21.294635+0000","last_undegraded":"2024-01-27T14:32:21.294635+0000","last_fullsized":"2024-01-27T14:32:21.294635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.238451+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:32:21.238451+0000","last_peered":"2024-01-27T14:32:21.238451+0000","last_clean":"2024-01-27T14:32:21.238451+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:32:21.238451+0000","last_undegraded":"2024-01-27T14:32:21.238451+0000","last_fullsized":"2024-01-27T14:32:21.238451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'7","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.745276+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:32:30.745276+0000","last_peered":"2024-01-27T14:32:30.745276+0000","last_clean":"2024-01-27T14:32:30.745276+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:32:30.745276+0000","last_undegraded":"2024-01-27T14:32:30.745276+0000","last_fullsized":"2024-01-27T14:32:30.745276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237454+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:32:21.237454+0000","last_peered":"2024-01-27T14:32:21.237454+0000","last_clean":"2024-01-27T14:32:21.237454+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:32:21.237454+0000","last_undegraded":"2024-01-27T14:32:21.237454+0000","last_fullsized":"2024-01-27T14:32:21.237454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295251+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:32:21.295251+0000","last_peered":"2024-01-27T14:32:21.295251+0000","last_clean":"2024-01-27T14:32:21.295251+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:32:21.295251+0000","last_undegraded":"2024-01-27T14:32:21.295251+0000","last_fullsized":"2024-01-27T14:32:21.295251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.830740+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:32:30.830740+0000","last_peered":"2024-01-27T14:32:30.830740+0000","last_clean":"2024-01-27T14:32:30.830740+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:32:30.830740+0000","last_undegraded":"2024-01-27T14:32:30.830740+0000","last_fullsized":"2024-01-27T14:32:30.830740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294883+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:32:21.294883+0000","last_peered":"2024-01-27T14:32:21.294883+0000","last_clean":"2024-01-27T14:32:21.294883+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:32:21.294883+0000","last_undegraded":"2024-01-27T14:32:21.294883+0000","last_fullsized":"2024-01-27T14:32:21.294883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295239+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:32:21.295239+0000","last_peered":"2024-01-27T14:32:21.295239+0000","last_clean":"2024-01-27T14:32:21.295239+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:32:21.295239+0000","last_undegraded":"2024-01-27T14:32:21.295239+0000","last_fullsized":"2024-01-27T14:32:21.295239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651104+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:32:21.651104+0000","last_peered":"2024-01-27T14:32:21.651104+0000","last_clean":"2024-01-27T14:32:21.651104+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:32:21.651104+0000","last_undegraded":"2024-01-27T14:32:21.651104+0000","last_fullsized":"2024-01-27T14:32:21.651104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294731+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:32:21.294731+0000","last_peered":"2024-01-27T14:32:21.294731+0000","last_clean":"2024-01-27T14:32:21.294731+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:32:21.294731+0000","last_undegraded":"2024-01-27T14:32:21.294731+0000","last_fullsized":"2024-01-27T14:32:21.294731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652309+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:32:21.652309+0000","last_peered":"2024-01-27T14:32:21.652309+0000","last_clean":"2024-01-27T14:32:21.652309+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:32:21.652309+0000","last_undegraded":"2024-01-27T14:32:21.652309+0000","last_fullsized":"2024-01-27T14:32:21.652309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.006555+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:32:33.006555+0000","last_peered":"2024-01-27T14:32:33.006555+0000","last_clean":"2024-01-27T14:32:33.006555+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:32:33.006555+0000","last_undegraded":"2024-01-27T14:32:33.006555+0000","last_fullsized":"2024-01-27T14:32:33.006555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654208+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:32:21.654208+0000","last_peered":"2024-01-27T14:32:21.654208+0000","last_clean":"2024-01-27T14:32:21.654208+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:32:21.654208+0000","last_undegraded":"2024-01-27T14:32:21.654208+0000","last_fullsized":"2024-01-27T14:32:21.654208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650497+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:32:21.650497+0000","last_peered":"2024-01-27T14:32:21.650497+0000","last_clean":"2024-01-27T14:32:21.650497+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:32:21.650497+0000","last_undegraded":"2024-01-27T14:32:21.650497+0000","last_fullsized":"2024-01-27T14:32:21.650497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.349735+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:32:28.349735+0000","last_peered":"2024-01-27T14:32:28.349735+0000","last_clean":"2024-01-27T14:32:28.349735+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:32:28.349735+0000","last_undegraded":"2024-01-27T14:32:28.349735+0000","last_fullsized":"2024-01-27T14:32:28.349735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295213+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:32:21.295213+0000","last_peered":"2024-01-27T14:32:21.295213+0000","last_clean":"2024-01-27T14:32:21.295213+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:32:21.295213+0000","last_undegraded":"2024-01-27T14:32:21.295213+0000","last_fullsized":"2024-01-27T14:32:21.295213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294709+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:32:21.294709+0000","last_peered":"2024-01-27T14:32:21.294709+0000","last_clean":"2024-01-27T14:32:21.294709+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:32:21.294709+0000","last_undegraded":"2024-01-27T14:32:21.294709+0000","last_fullsized":"2024-01-27T14:32:21.294709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.319369+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:32:28.319369+0000","last_peered":"2024-01-27T14:32:28.319369+0000","last_clean":"2024-01-27T14:32:28.319369+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:32:28.319369+0000","last_undegraded":"2024-01-27T14:32:28.319369+0000","last_fullsized":"2024-01-27T14:32:28.319369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651175+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:32:21.651175+0000","last_peered":"2024-01-27T14:32:21.651175+0000","last_clean":"2024-01-27T14:32:21.651175+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:32:21.651175+0000","last_undegraded":"2024-01-27T14:32:21.651175+0000","last_fullsized":"2024-01-27T14:32:21.651175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237816+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:32:21.237816+0000","last_peered":"2024-01-27T14:32:21.237816+0000","last_clean":"2024-01-27T14:32:21.237816+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:32:21.237816+0000","last_undegraded":"2024-01-27T14:32:21.237816+0000","last_fullsized":"2024-01-27T14:32:21.237816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831029+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:32:30.831029+0000","last_peered":"2024-01-27T14:32:30.831029+0000","last_clean":"2024-01-27T14:32:30.831029+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:32:30.831029+0000","last_undegraded":"2024-01-27T14:32:30.831029+0000","last_fullsized":"2024-01-27T14:32:30.831029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241460+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:32:21.241460+0000","last_peered":"2024-01-27T14:32:21.241460+0000","last_clean":"2024-01-27T14:32:21.241460+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:32:21.241460+0000","last_undegraded":"2024-01-27T14:32:21.241460+0000","last_fullsized":"2024-01-27T14:32:21.241460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651549+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:32:21.651549+0000","last_peered":"2024-01-27T14:32:21.651549+0000","last_clean":"2024-01-27T14:32:21.651549+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:32:21.651549+0000","last_undegraded":"2024-01-27T14:32:21.651549+0000","last_fullsized":"2024-01-27T14:32:21.651549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651447+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:32:21.651447+0000","last_peered":"2024-01-27T14:32:21.651447+0000","last_clean":"2024-01-27T14:32:21.651447+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:32:21.651447+0000","last_undegraded":"2024-01-27T14:32:21.651447+0000","last_fullsized":"2024-01-27T14:32:21.651447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.738948+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:32:30.738948+0000","last_peered":"2024-01-27T14:32:30.738948+0000","last_clean":"2024-01-27T14:32:30.738948+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:32:30.738948+0000","last_undegraded":"2024-01-27T14:32:30.738948+0000","last_fullsized":"2024-01-27T14:32:30.738948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294745+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:32:21.294745+0000","last_peered":"2024-01-27T14:32:21.294745+0000","last_clean":"2024-01-27T14:32:21.294745+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:32:21.294745+0000","last_undegraded":"2024-01-27T14:32:21.294745+0000","last_fullsized":"2024-01-27T14:32:21.294745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652358+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:32:21.652358+0000","last_peered":"2024-01-27T14:32:21.652358+0000","last_clean":"2024-01-27T14:32:21.652358+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:32:21.652358+0000","last_undegraded":"2024-01-27T14:32:21.652358+0000","last_fullsized":"2024-01-27T14:32:21.652358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.863179+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:32:30.863179+0000","last_peered":"2024-01-27T14:32:30.863179+0000","last_clean":"2024-01-27T14:32:30.863179+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:32:30.863179+0000","last_undegraded":"2024-01-27T14:32:30.863179+0000","last_fullsized":"2024-01-27T14:32:30.863179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650897+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:32:21.650897+0000","last_peered":"2024-01-27T14:32:21.650897+0000","last_clean":"2024-01-27T14:32:21.650897+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:32:21.650897+0000","last_undegraded":"2024-01-27T14:32:21.650897+0000","last_fullsized":"2024-01-27T14:32:21.650897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652032+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:32:21.652032+0000","last_peered":"2024-01-27T14:32:21.652032+0000","last_clean":"2024-01-27T14:32:21.652032+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:32:21.652032+0000","last_undegraded":"2024-01-27T14:32:21.652032+0000","last_fullsized":"2024-01-27T14:32:21.652032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.995877+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:32:32.995877+0000","last_peered":"2024-01-27T14:32:32.995877+0000","last_clean":"2024-01-27T14:32:32.995877+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:32:32.995877+0000","last_undegraded":"2024-01-27T14:32:32.995877+0000","last_fullsized":"2024-01-27T14:32:32.995877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651571+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:32:21.651571+0000","last_peered":"2024-01-27T14:32:21.651571+0000","last_clean":"2024-01-27T14:32:21.651571+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:32:21.651571+0000","last_undegraded":"2024-01-27T14:32:21.651571+0000","last_fullsized":"2024-01-27T14:32:21.651571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295584+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:32:21.295584+0000","last_peered":"2024-01-27T14:32:21.295584+0000","last_clean":"2024-01-27T14:32:21.295584+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:32:21.295584+0000","last_undegraded":"2024-01-27T14:32:21.295584+0000","last_fullsized":"2024-01-27T14:32:21.295584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652184+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:32:21.652184+0000","last_peered":"2024-01-27T14:32:21.652184+0000","last_clean":"2024-01-27T14:32:21.652184+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:32:21.652184+0000","last_undegraded":"2024-01-27T14:32:21.652184+0000","last_fullsized":"2024-01-27T14:32:21.652184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241389+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:32:21.241389+0000","last_peered":"2024-01-27T14:32:21.241389+0000","last_clean":"2024-01-27T14:32:21.241389+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:32:21.241389+0000","last_undegraded":"2024-01-27T14:32:21.241389+0000","last_fullsized":"2024-01-27T14:32:21.241389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651770+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:32:21.651770+0000","last_peered":"2024-01-27T14:32:21.651770+0000","last_clean":"2024-01-27T14:32:21.651770+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:32:21.651770+0000","last_undegraded":"2024-01-27T14:32:21.651770+0000","last_fullsized":"2024-01-27T14:32:21.651770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.747562+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:32:30.747562+0000","last_peered":"2024-01-27T14:32:30.747562+0000","last_clean":"2024-01-27T14:32:30.747562+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:32:30.747562+0000","last_undegraded":"2024-01-27T14:32:30.747562+0000","last_fullsized":"2024-01-27T14:32:30.747562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651327+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:32:21.651327+0000","last_peered":"2024-01-27T14:32:21.651327+0000","last_clean":"2024-01-27T14:32:21.651327+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:32:21.651327+0000","last_undegraded":"2024-01-27T14:32:21.651327+0000","last_fullsized":"2024-01-27T14:32:21.651327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241363+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:32:21.241363+0000","last_peered":"2024-01-27T14:32:21.241363+0000","last_clean":"2024-01-27T14:32:21.241363+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:32:21.241363+0000","last_undegraded":"2024-01-27T14:32:21.241363+0000","last_fullsized":"2024-01-27T14:32:21.241363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.862077+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:32:30.862077+0000","last_peered":"2024-01-27T14:32:30.862077+0000","last_clean":"2024-01-27T14:32:30.862077+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:32:30.862077+0000","last_undegraded":"2024-01-27T14:32:30.862077+0000","last_fullsized":"2024-01-27T14:32:30.862077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651305+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:32:21.651305+0000","last_peered":"2024-01-27T14:32:21.651305+0000","last_clean":"2024-01-27T14:32:21.651305+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:32:21.651305+0000","last_undegraded":"2024-01-27T14:32:21.651305+0000","last_fullsized":"2024-01-27T14:32:21.651305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652240+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:32:21.652240+0000","last_peered":"2024-01-27T14:32:21.652240+0000","last_clean":"2024-01-27T14:32:21.652240+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:32:21.652240+0000","last_undegraded":"2024-01-27T14:32:21.652240+0000","last_fullsized":"2024-01-27T14:32:21.652240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831231+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:32:30.831231+0000","last_peered":"2024-01-27T14:32:30.831231+0000","last_clean":"2024-01-27T14:32:30.831231+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:32:30.831231+0000","last_undegraded":"2024-01-27T14:32:30.831231+0000","last_fullsized":"2024-01-27T14:32:30.831231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294990+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:32:21.294990+0000","last_peered":"2024-01-27T14:32:21.294990+0000","last_clean":"2024-01-27T14:32:21.294990+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:32:21.294990+0000","last_undegraded":"2024-01-27T14:32:21.294990+0000","last_fullsized":"2024-01-27T14:32:21.294990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294975+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:32:21.294975+0000","last_peered":"2024-01-27T14:32:21.294975+0000","last_clean":"2024-01-27T14:32:21.294975+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.294975+0000","last_undegraded":"2024-01-27T14:32:21.294975+0000","last_fullsized":"2024-01-27T14:32:21.294975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.003237+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:32:33.003237+0000","last_peered":"2024-01-27T14:32:33.003237+0000","last_clean":"2024-01-27T14:32:33.003237+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:32:33.003237+0000","last_undegraded":"2024-01-27T14:32:33.003237+0000","last_fullsized":"2024-01-27T14:32:33.003237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.655214+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:32:21.655214+0000","last_peered":"2024-01-27T14:32:21.655214+0000","last_clean":"2024-01-27T14:32:21.655214+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:32:21.655214+0000","last_undegraded":"2024-01-27T14:32:21.655214+0000","last_fullsized":"2024-01-27T14:32:21.655214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652753+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:32:21.652753+0000","last_peered":"2024-01-27T14:32:21.652753+0000","last_clean":"2024-01-27T14:32:21.652753+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:32:21.652753+0000","last_undegraded":"2024-01-27T14:32:21.652753+0000","last_fullsized":"2024-01-27T14:32:21.652753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:33.006514+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:32:33.006514+0000","last_peered":"2024-01-27T14:32:33.006514+0000","last_clean":"2024-01-27T14:32:33.006514+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:32:33.006514+0000","last_undegraded":"2024-01-27T14:32:33.006514+0000","last_fullsized":"2024-01-27T14:32:33.006514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237928+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:32:21.237928+0000","last_peered":"2024-01-27T14:32:21.237928+0000","last_clean":"2024-01-27T14:32:21.237928+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:32:21.237928+0000","last_undegraded":"2024-01-27T14:32:21.237928+0000","last_fullsized":"2024-01-27T14:32:21.237928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651594+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:32:21.651594+0000","last_peered":"2024-01-27T14:32:21.651594+0000","last_clean":"2024-01-27T14:32:21.651594+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:32:21.651594+0000","last_undegraded":"2024-01-27T14:32:21.651594+0000","last_fullsized":"2024-01-27T14:32:21.651594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.876465+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:32:25.876465+0000","last_peered":"2024-01-27T14:32:25.876465+0000","last_clean":"2024-01-27T14:32:25.876465+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:32:25.876465+0000","last_undegraded":"2024-01-27T14:32:25.876465+0000","last_fullsized":"2024-01-27T14:32:25.876465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294920+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:32:21.294920+0000","last_peered":"2024-01-27T14:32:21.294920+0000","last_clean":"2024-01-27T14:32:21.294920+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:32:21.294920+0000","last_undegraded":"2024-01-27T14:32:21.294920+0000","last_fullsized":"2024-01-27T14:32:21.294920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651487+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:32:21.651487+0000","last_peered":"2024-01-27T14:32:21.651487+0000","last_clean":"2024-01-27T14:32:21.651487+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:32:21.651487+0000","last_undegraded":"2024-01-27T14:32:21.651487+0000","last_fullsized":"2024-01-27T14:32:21.651487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:32.910631+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:32:32.910631+0000","last_peered":"2024-01-27T14:32:32.910631+0000","last_clean":"2024-01-27T14:32:32.910631+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:32:32.910631+0000","last_undegraded":"2024-01-27T14:32:32.910631+0000","last_fullsized":"2024-01-27T14:32:32.910631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.292926+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:32:21.292926+0000","last_peered":"2024-01-27T14:32:21.292926+0000","last_clean":"2024-01-27T14:32:21.292926+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:32:21.292926+0000","last_undegraded":"2024-01-27T14:32:21.292926+0000","last_fullsized":"2024-01-27T14:32:21.292926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295496+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:32:21.295496+0000","last_peered":"2024-01-27T14:32:21.295496+0000","last_clean":"2024-01-27T14:32:21.295496+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:32:21.295496+0000","last_undegraded":"2024-01-27T14:32:21.295496+0000","last_fullsized":"2024-01-27T14:32:21.295496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.972769+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:32:25.972769+0000","last_peered":"2024-01-27T14:32:25.972769+0000","last_clean":"2024-01-27T14:32:25.972769+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:32:25.972769+0000","last_undegraded":"2024-01-27T14:32:25.972769+0000","last_fullsized":"2024-01-27T14:32:25.972769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237746+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:32:21.237746+0000","last_peered":"2024-01-27T14:32:21.237746+0000","last_clean":"2024-01-27T14:32:21.237746+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:32:21.237746+0000","last_undegraded":"2024-01-27T14:32:21.237746+0000","last_fullsized":"2024-01-27T14:32:21.237746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654246+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:32:21.654246+0000","last_peered":"2024-01-27T14:32:21.654246+0000","last_clean":"2024-01-27T14:32:21.654246+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:32:21.654246+0000","last_undegraded":"2024-01-27T14:32:21.654246+0000","last_fullsized":"2024-01-27T14:32:21.654246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237784+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:32:21.237784+0000","last_peered":"2024-01-27T14:32:21.237784+0000","last_clean":"2024-01-27T14:32:21.237784+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:32:21.237784+0000","last_undegraded":"2024-01-27T14:32:21.237784+0000","last_fullsized":"2024-01-27T14:32:21.237784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.830902+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:32:30.830902+0000","last_peered":"2024-01-27T14:32:30.830902+0000","last_clean":"2024-01-27T14:32:30.830902+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:32:30.830902+0000","last_undegraded":"2024-01-27T14:32:30.830902+0000","last_fullsized":"2024-01-27T14:32:30.830902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652002+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:32:21.652002+0000","last_peered":"2024-01-27T14:32:21.652002+0000","last_clean":"2024-01-27T14:32:21.652002+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:32:21.652002+0000","last_undegraded":"2024-01-27T14:32:21.652002+0000","last_fullsized":"2024-01-27T14:32:21.652002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650619+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:32:21.650619+0000","last_peered":"2024-01-27T14:32:21.650619+0000","last_clean":"2024-01-27T14:32:21.650619+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:32:21.650619+0000","last_undegraded":"2024-01-27T14:32:21.650619+0000","last_fullsized":"2024-01-27T14:32:21.650619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:28.298175+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:32:28.298175+0000","last_peered":"2024-01-27T14:32:28.298175+0000","last_clean":"2024-01-27T14:32:28.298175+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:32:28.298175+0000","last_undegraded":"2024-01-27T14:32:28.298175+0000","last_fullsized":"2024-01-27T14:32:28.298175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:30.831042+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:32:30.831042+0000","last_peered":"2024-01-27T14:32:30.831042+0000","last_clean":"2024-01-27T14:32:30.831042+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:32:30.831042+0000","last_undegraded":"2024-01-27T14:32:30.831042+0000","last_fullsized":"2024-01-27T14:32:30.831042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237832+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:32:21.237832+0000","last_peered":"2024-01-27T14:32:21.237832+0000","last_clean":"2024-01-27T14:32:21.237832+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:32:21.237832+0000","last_undegraded":"2024-01-27T14:32:21.237832+0000","last_fullsized":"2024-01-27T14:32:21.237832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237968+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:32:21.237968+0000","last_peered":"2024-01-27T14:32:21.237968+0000","last_clean":"2024-01-27T14:32:21.237968+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:32:21.237968+0000","last_undegraded":"2024-01-27T14:32:21.237968+0000","last_fullsized":"2024-01-27T14:32:21.237968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:25.955129+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:32:25.955129+0000","last_peered":"2024-01-27T14:32:25.955129+0000","last_clean":"2024-01-27T14:32:25.955129+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:32:25.955129+0000","last_undegraded":"2024-01-27T14:32:25.955129+0000","last_fullsized":"2024-01-27T14:32:25.955129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241561+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:32:21.241561+0000","last_peered":"2024-01-27T14:32:21.241561+0000","last_clean":"2024-01-27T14:32:21.241561+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:32:21.241561+0000","last_undegraded":"2024-01-27T14:32:21.241561+0000","last_fullsized":"2024-01-27T14:32:21.241561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293607+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:32:21.293607+0000","last_peered":"2024-01-27T14:32:21.293607+0000","last_clean":"2024-01-27T14:32:21.293607+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:32:21.293607+0000","last_undegraded":"2024-01-27T14:32:21.293607+0000","last_fullsized":"2024-01-27T14:32:21.293607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294584+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:32:21.294584+0000","last_peered":"2024-01-27T14:32:21.294584+0000","last_clean":"2024-01-27T14:32:21.294584+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:32:21.294584+0000","last_undegraded":"2024-01-27T14:32:21.294584+0000","last_fullsized":"2024-01-27T14:32:21.294584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293063+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:32:21.293063+0000","last_peered":"2024-01-27T14:32:21.293063+0000","last_clean":"2024-01-27T14:32:21.293063+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:32:21.293063+0000","last_undegraded":"2024-01-27T14:32:21.293063+0000","last_fullsized":"2024-01-27T14:32:21.293063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651459+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:32:21.651459+0000","last_peered":"2024-01-27T14:32:21.651459+0000","last_clean":"2024-01-27T14:32:21.651459+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:32:21.651459+0000","last_undegraded":"2024-01-27T14:32:21.651459+0000","last_fullsized":"2024-01-27T14:32:21.651459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650996+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:32:21.650996+0000","last_peered":"2024-01-27T14:32:21.650996+0000","last_clean":"2024-01-27T14:32:21.650996+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:32:21.650996+0000","last_undegraded":"2024-01-27T14:32:21.650996+0000","last_fullsized":"2024-01-27T14:32:21.650996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295167+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:32:21.295167+0000","last_peered":"2024-01-27T14:32:21.295167+0000","last_clean":"2024-01-27T14:32:21.295167+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:32:21.295167+0000","last_undegraded":"2024-01-27T14:32:21.295167+0000","last_fullsized":"2024-01-27T14:32:21.295167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295361+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:32:21.295361+0000","last_peered":"2024-01-27T14:32:21.295361+0000","last_clean":"2024-01-27T14:32:21.295361+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:32:21.295361+0000","last_undegraded":"2024-01-27T14:32:21.295361+0000","last_fullsized":"2024-01-27T14:32:21.295361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295399+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:32:21.295399+0000","last_peered":"2024-01-27T14:32:21.295399+0000","last_clean":"2024-01-27T14:32:21.295399+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:32:21.295399+0000","last_undegraded":"2024-01-27T14:32:21.295399+0000","last_fullsized":"2024-01-27T14:32:21.295399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651227+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:32:21.651227+0000","last_peered":"2024-01-27T14:32:21.651227+0000","last_clean":"2024-01-27T14:32:21.651227+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:32:21.651227+0000","last_undegraded":"2024-01-27T14:32:21.651227+0000","last_fullsized":"2024-01-27T14:32:21.651227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651809+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:32:21.651809+0000","last_peered":"2024-01-27T14:32:21.651809+0000","last_clean":"2024-01-27T14:32:21.651809+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:32:21.651809+0000","last_undegraded":"2024-01-27T14:32:21.651809+0000","last_fullsized":"2024-01-27T14:32:21.651809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650583+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:32:21.650583+0000","last_peered":"2024-01-27T14:32:21.650583+0000","last_clean":"2024-01-27T14:32:21.650583+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:32:21.650583+0000","last_undegraded":"2024-01-27T14:32:21.650583+0000","last_fullsized":"2024-01-27T14:32:21.650583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241509+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:32:21.241509+0000","last_peered":"2024-01-27T14:32:21.241509+0000","last_clean":"2024-01-27T14:32:21.241509+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:32:21.241509+0000","last_undegraded":"2024-01-27T14:32:21.241509+0000","last_fullsized":"2024-01-27T14:32:21.241509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.237731+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:32:21.237731+0000","last_peered":"2024-01-27T14:32:21.237731+0000","last_clean":"2024-01-27T14:32:21.237731+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:32:21.237731+0000","last_undegraded":"2024-01-27T14:32:21.237731+0000","last_fullsized":"2024-01-27T14:32:21.237731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652272+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:32:21.652272+0000","last_peered":"2024-01-27T14:32:21.652272+0000","last_clean":"2024-01-27T14:32:21.652272+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:32:21.652272+0000","last_undegraded":"2024-01-27T14:32:21.652272+0000","last_fullsized":"2024-01-27T14:32:21.652272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651644+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:32:21.651644+0000","last_peered":"2024-01-27T14:32:21.651644+0000","last_clean":"2024-01-27T14:32:21.651644+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:32:21.651644+0000","last_undegraded":"2024-01-27T14:32:21.651644+0000","last_fullsized":"2024-01-27T14:32:21.651644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.293934+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:32:21.293934+0000","last_peered":"2024-01-27T14:32:21.293934+0000","last_clean":"2024-01-27T14:32:21.293934+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:32:21.293934+0000","last_undegraded":"2024-01-27T14:32:21.293934+0000","last_fullsized":"2024-01-27T14:32:21.293934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652172+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:32:21.652172+0000","last_peered":"2024-01-27T14:32:21.652172+0000","last_clean":"2024-01-27T14:32:21.652172+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:32:21.652172+0000","last_undegraded":"2024-01-27T14:32:21.652172+0000","last_fullsized":"2024-01-27T14:32:21.652172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651716+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:32:21.651716+0000","last_peered":"2024-01-27T14:32:21.651716+0000","last_clean":"2024-01-27T14:32:21.651716+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:32:21.651716+0000","last_undegraded":"2024-01-27T14:32:21.651716+0000","last_fullsized":"2024-01-27T14:32:21.651716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650693+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:32:21.650693+0000","last_peered":"2024-01-27T14:32:21.650693+0000","last_clean":"2024-01-27T14:32:21.650693+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:32:21.650693+0000","last_undegraded":"2024-01-27T14:32:21.650693+0000","last_fullsized":"2024-01-27T14:32:21.650693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294879+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:32:21.294879+0000","last_peered":"2024-01-27T14:32:21.294879+0000","last_clean":"2024-01-27T14:32:21.294879+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:32:21.294879+0000","last_undegraded":"2024-01-27T14:32:21.294879+0000","last_fullsized":"2024-01-27T14:32:21.294879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.295073+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:32:21.295073+0000","last_peered":"2024-01-27T14:32:21.295073+0000","last_clean":"2024-01-27T14:32:21.295073+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:32:21.295073+0000","last_undegraded":"2024-01-27T14:32:21.295073+0000","last_fullsized":"2024-01-27T14:32:21.295073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652186+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:32:21.652186+0000","last_peered":"2024-01-27T14:32:21.652186+0000","last_clean":"2024-01-27T14:32:21.652186+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:32:21.652186+0000","last_undegraded":"2024-01-27T14:32:21.652186+0000","last_fullsized":"2024-01-27T14:32:21.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652698+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:32:21.652698+0000","last_peered":"2024-01-27T14:32:21.652698+0000","last_clean":"2024-01-27T14:32:21.652698+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:32:21.652698+0000","last_undegraded":"2024-01-27T14:32:21.652698+0000","last_fullsized":"2024-01-27T14:32:21.652698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.652572+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:32:21.652572+0000","last_peered":"2024-01-27T14:32:21.652572+0000","last_clean":"2024-01-27T14:32:21.652572+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:32:21.652572+0000","last_undegraded":"2024-01-27T14:32:21.652572+0000","last_fullsized":"2024-01-27T14:32:21.652572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.241969+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:32:21.241969+0000","last_peered":"2024-01-27T14:32:21.241969+0000","last_clean":"2024-01-27T14:32:21.241969+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:32:21.241969+0000","last_undegraded":"2024-01-27T14:32:21.241969+0000","last_fullsized":"2024-01-27T14:32:21.241969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.650428+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:32:21.650428+0000","last_peered":"2024-01-27T14:32:21.650428+0000","last_clean":"2024-01-27T14:32:21.650428+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:32:21.650428+0000","last_undegraded":"2024-01-27T14:32:21.650428+0000","last_fullsized":"2024-01-27T14:32:21.650428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651824+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:32:21.651824+0000","last_peered":"2024-01-27T14:32:21.651824+0000","last_clean":"2024-01-27T14:32:21.651824+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:32:21.651824+0000","last_undegraded":"2024-01-27T14:32:21.651824+0000","last_fullsized":"2024-01-27T14:32:21.651824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294824+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:32:21.294824+0000","last_peered":"2024-01-27T14:32:21.294824+0000","last_clean":"2024-01-27T14:32:21.294824+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:32:21.294824+0000","last_undegraded":"2024-01-27T14:32:21.294824+0000","last_fullsized":"2024-01-27T14:32:21.294824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.654122+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:32:21.654122+0000","last_peered":"2024-01-27T14:32:21.654122+0000","last_clean":"2024-01-27T14:32:21.654122+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:32:21.654122+0000","last_undegraded":"2024-01-27T14:32:21.654122+0000","last_fullsized":"2024-01-27T14:32:21.654122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.294919+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:32:21.294919+0000","last_peered":"2024-01-27T14:32:21.294919+0000","last_clean":"2024-01-27T14:32:21.294919+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:32:21.294919+0000","last_undegraded":"2024-01-27T14:32:21.294919+0000","last_fullsized":"2024-01-27T14:32:21.294919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651126+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:32:21.651126+0000","last_peered":"2024-01-27T14:32:21.651126+0000","last_clean":"2024-01-27T14:32:21.651126+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:32:21.651126+0000","last_undegraded":"2024-01-27T14:32:21.651126+0000","last_fullsized":"2024-01-27T14:32:21.651126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651251+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:32:21.651251+0000","last_peered":"2024-01-27T14:32:21.651251+0000","last_clean":"2024-01-27T14:32:21.651251+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:32:21.651251+0000","last_undegraded":"2024-01-27T14:32:21.651251+0000","last_fullsized":"2024-01-27T14:32:21.651251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:32:21.651939+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:32:21.651939+0000","last_peered":"2024-01-27T14:32:21.651939+0000","last_clean":"2024-01-27T14:32:21.651939+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:32:21.651939+0000","last_undegraded":"2024-01-27T14:32:21.651939+0000","last_fullsized":"2024-01-27T14:32:21.651939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10263,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":126159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":716299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.433}]},{"osd":1,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.317},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.379},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.36799999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.35599999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":127827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":1.073},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":1.097},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.95299999999999996}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":1.022}]},{"osd":5,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.0469999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":129014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.66600000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.872},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47199999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":921600,"data_stored":716887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.374}]},{"osd":2,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53400000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":127647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.217},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.315}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.439}]},{"osd":5,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.373},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":127485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:32:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":130604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Jan 27 14:32:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:32:36.551 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-27T14:32:36.551 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-27T14:32:36.551 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-27T14:32:36.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-27T14:32:36.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 Processor -- start 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 -- start start 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d84153b00 0x7f4d840cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 0x7f4d840ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 0x7f4d840b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8415a8a0 con 0x7f4d840ca600 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d840b2ca0 con 0x7f4d84153b00 2024-01-27T14:32:36.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.690+0000 7f4d89b9e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840b3280 con 0x7f4d840cf2c0 2024-01-27T14:32:36.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.691+0000 7f4d83fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 0x7f4d840b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.691+0000 7f4d82ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 0x7f4d840ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.691+0000 7f4d837fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d84153b00 0x7f4d840cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.691+0000 7f4d83fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 0x7f4d840b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35500/0 (socket says 172.21.15.46:35500) 2024-01-27T14:32:36.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.691+0000 7f4d83fff640 1 -- 172.21.15.46:0/2820988222 learned_addr learned my addr 172.21.15.46:0/2820988222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:36.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.694+0000 7f4d82ffd640 1 -- 172.21.15.46:0/2820988222 >> v2:172.21.15.73:3300/0 conn(0x7f4d84153b00 msgr2=0x7f4d840cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:36.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.694+0000 7f4d82ffd640 1 --2- 172.21.15.46:0/2820988222 >> v2:172.21.15.73:3300/0 conn(0x7f4d84153b00 0x7f4d840cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.694+0000 7f4d82ffd640 1 -- 172.21.15.46:0/2820988222 >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 msgr2=0x7f4d840b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:36.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.694+0000 7f4d82ffd640 1 --2- 172.21.15.46:0/2820988222 >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 0x7f4d840b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.694+0000 7f4d82ffd640 1 -- 172.21.15.46:0/2820988222 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8415d0d0 con 0x7f4d840cf2c0 2024-01-27T14:32:36.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.696+0000 7f4d82ffd640 1 --2- 172.21.15.46:0/2820988222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 0x7f4d840ca0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d8408cbd0 tx=0x7f4d7802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09acc74c362c1c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.699+0000 7f4d827fc640 1 -- 172.21.15.46:0/2820988222 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78031830 con 0x7f4d840cf2c0 2024-01-27T14:32:36.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.699+0000 7f4d827fc640 1 -- 172.21.15.46:0/2820988222 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78031990 con 0x7f4d840cf2c0 2024-01-27T14:32:36.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.699+0000 7f4d827fc640 1 -- 172.21.15.46:0/2820988222 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78031d20 con 0x7f4d840cf2c0 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2820988222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 msgr2=0x7f4d840ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2820988222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 0x7f4d840ca0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d8408cbd0 tx=0x7f4d7802b8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2820988222 shutdown_connections 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2820988222 >> v2:172.21.15.46:3300/0 conn(0x7f4d840ca600 0x7f4d840b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2820988222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d840cf2c0 0x7f4d840ca0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2820988222 >> v2:172.21.15.73:3300/0 conn(0x7f4d84153b00 0x7f4d840cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2820988222 >> 172.21.15.46:0/2820988222 conn(0x7f4d8408b190 msgr2=0x7f4d8408b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:36.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2820988222 shutdown_connections 2024-01-27T14:32:36.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.700+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2820988222 wait complete. 2024-01-27T14:32:36.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.701+0000 7f4d89b9e640 1 Processor -- start 2024-01-27T14:32:36.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.701+0000 7f4d89b9e640 1 -- start start 2024-01-27T14:32:36.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d840cf2c0 0x7f4d841e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d84153b00 0x7f4d841ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8414f590 con 0x7f4d840ca600 2024-01-27T14:32:36.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841e5980 con 0x7f4d840cf2c0 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.702+0000 7f4d89b9e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840c3f70 con 0x7f4d84153b00 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.703+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.703+0000 7f4d83fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d84153b00 0x7f4d841ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.703+0000 7f4d82ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d840cf2c0 0x7f4d841e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.703+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35512/0 (socket says 172.21.15.46:35512) 2024-01-27T14:32:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.703+0000 7f4d837fe640 1 -- 172.21.15.46:0/2321527279 learned_addr learned my addr 172.21.15.46:0/2321527279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:36.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.706+0000 7f4d837fe640 1 -- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d84153b00 msgr2=0x7f4d841ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.706+0000 7f4d837fe640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d84153b00 0x7f4d841ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.706+0000 7f4d837fe640 1 -- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d840cf2c0 msgr2=0x7f4d841e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:36.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.706+0000 7f4d837fe640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d840cf2c0 0x7f4d841e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:36.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.706+0000 7f4d837fe640 1 -- 172.21.15.46:0/2321527279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009400 con 0x7f4d840ca600 2024-01-27T14:32:36.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.709+0000 7f4d837fe640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400e8a0 tx=0x7f4d7400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.712+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740094f0 con 0x7f4d840ca600 2024-01-27T14:32:36.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.713+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400c940 con 0x7f4d840ca600 2024-01-27T14:32:36.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.713+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840c4510 con 0x7f4d840ca600 2024-01-27T14:32:36.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.713+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400ccf0 con 0x7f4d840ca600 2024-01-27T14:32:36.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.713+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840c4ad0 con 0x7f4d840ca600 2024-01-27T14:32:36.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.714+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d840742e0 con 0x7f4d840ca600 2024-01-27T14:32:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.977+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4d74013470 con 0x7f4d840ca600 2024-01-27T14:32:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.977+0000 7f4d6bfff640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 0x7f4d7006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.977+0000 7f4d82ffd640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 0x7f4d7006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.978+0000 7f4d82ffd640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 0x7f4d7006d3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d78036000 tx=0x7f4d7803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:36.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.991+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4d74058a30 con 0x7f4d840ca600 2024-01-27T14:32:36.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:36.991+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4d74054d70 con 0x7f4d840ca600 2024-01-27T14:32:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.220+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d840cc870 con 0x7f4d840ca600 2024-01-27T14:32:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.225+0000 7f4d6bfff640 1 -- 172.21.15.46:0/2321527279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4d74021040 con 0x7f4d840ca600 2024-01-27T14:32:37.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:37.222 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-27T14:32:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 msgr2=0x7f4d7006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 0x7f4d7006d3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d78036000 tx=0x7f4d7803c040 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 msgr2=0x7f4d840ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400e8a0 tx=0x7f4d7400ed60 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 shutdown_connections 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d7006af20 0x7f4d7006d3e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d840cf2c0 0x7f4d841e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d84153b00 0x7f4d841ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 --2- 172.21.15.46:0/2321527279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d840ca600 0x7f4d840ce710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.227+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 >> 172.21.15.46:0/2321527279 conn(0x7f4d8408b190 msgr2=0x7f4d84159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.228+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 shutdown_connections 2024-01-27T14:32:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.228+0000 7f4d89b9e640 1 -- 172.21.15.46:0/2321527279 wait complete. 2024-01-27T14:32:37.235 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-27T14:32:37.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:37.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.340+0000 7f5401ece640 1 Processor -- start 2024-01-27T14:32:37.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.340+0000 7f5401ece640 1 -- start start 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53fc153ac0 0x7f53fc0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53fc15d6e0 0x7f53fc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0c5230 con 0x7f53fc15d6e0 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0c4ee0 con 0x7f53fc153ac0 2024-01-27T14:32:37.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.341+0000 7f5401ece640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc153ea0 con 0x7f53fc0cf7c0 2024-01-27T14:32:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.342+0000 7f53faffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53fc15d6e0 0x7f53fc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.342+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.342+0000 7f53fb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53fc153ac0 0x7f53fc0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.342+0000 7f53faffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53fc15d6e0 0x7f53fc0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35522/0 (socket says 172.21.15.46:35522) 2024-01-27T14:32:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.342+0000 7f53faffd640 1 -- 172.21.15.46:0/278226022 learned_addr learned my addr 172.21.15.46:0/278226022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.344+0000 7f53faffd640 1 -- 172.21.15.46:0/278226022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 msgr2=0x7f53fc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.344+0000 7f53faffd640 1 --2- 172.21.15.46:0/278226022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.344+0000 7f53faffd640 1 -- 172.21.15.46:0/278226022 >> v2:172.21.15.73:3300/0 conn(0x7f53fc153ac0 msgr2=0x7f53fc0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.344+0000 7f53faffd640 1 --2- 172.21.15.46:0/278226022 >> v2:172.21.15.73:3300/0 conn(0x7f53fc153ac0 0x7f53fc0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.344+0000 7f53faffd640 1 -- 172.21.15.46:0/278226022 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0c3ff0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.347+0000 7f53faffd640 1 --2- 172.21.15.46:0/278226022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc15d6e0 0x7f53fc0cf280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ca5d0 tx=0x7f53f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75edea9b55d524a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f53fa7fc640 1 -- 172.21.15.46:0/278226022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0030860 con 0x7f53fc15d6e0 2024-01-27T14:32:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f53fa7fc640 1 -- 172.21.15.46:0/278226022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f00309c0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f53fa7fc640 1 -- 172.21.15.46:0/278226022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0030d50 con 0x7f53fc15d6e0 2024-01-27T14:32:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 -- 172.21.15.46:0/278226022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc15d6e0 msgr2=0x7f53fc0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 --2- 172.21.15.46:0/278226022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc15d6e0 0x7f53fc0cf280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ca5d0 tx=0x7f53f002b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 -- 172.21.15.46:0/278226022 shutdown_connections 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 --2- 172.21.15.46:0/278226022 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 --2- 172.21.15.46:0/278226022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc15d6e0 0x7f53fc0cf280 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 --2- 172.21.15.46:0/278226022 >> v2:172.21.15.73:3300/0 conn(0x7f53fc153ac0 0x7f53fc0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 -- 172.21.15.46:0/278226022 >> 172.21.15.46:0/278226022 conn(0x7f53fc06cca0 msgr2=0x7f53fc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.352+0000 7f5401ece640 1 -- 172.21.15.46:0/278226022 shutdown_connections 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.353+0000 7f5401ece640 1 -- 172.21.15.46:0/278226022 wait complete. 2024-01-27T14:32:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.354+0000 7f5401ece640 1 Processor -- start 2024-01-27T14:32:37.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.354+0000 7f5401ece640 1 -- start start 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc153ac0 0x7f53fc158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0b2960 con 0x7f53fc153ac0 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0c7330 con 0x7f53fc15d6e0 2024-01-27T14:32:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.355+0000 7f5401ece640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc15d120 con 0x7f53fc0cf7c0 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc153ac0 0x7f53fc158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57428/0 (socket says 172.21.15.46:57428) 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53fb7fe640 1 -- 172.21.15.46:0/468851071 learned_addr learned my addr 172.21.15.46:0/468851071 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.356+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50772/0 (socket says 172.21.15.46:50772) 2024-01-27T14:32:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.359+0000 7f53fbfff640 1 -- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 msgr2=0x7f53fc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.359+0000 7f53fbfff640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.359+0000 7f53fbfff640 1 -- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc153ac0 msgr2=0x7f53fc158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.359+0000 7f53fbfff640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc153ac0 0x7f53fc158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.359+0000 7f53fbfff640 1 -- 172.21.15.46:0/468851071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00094d0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.362+0000 7f53fbfff640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53f400ef00 tx=0x7f53f400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.365+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4010040 con 0x7f53fc15d6e0 2024-01-27T14:32:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.365+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4009e60 con 0x7f53fc15d6e0 2024-01-27T14:32:37.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.365+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc1599c0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.365+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4014640 con 0x7f53fc15d6e0 2024-01-27T14:32:37.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.365+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc159f80 con 0x7f53fc15d6e0 2024-01-27T14:32:37.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.366+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc06ca90 con 0x7f53fc15d6e0 2024-01-27T14:32:37.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.608+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f53f40147a0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.609+0000 7f53e3fff640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 0x7f53e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.609+0000 7f53fb7fe640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 0x7f53e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.609+0000 7f53fb7fe640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 0x7f53e806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009c00 tx=0x7f53ec009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:37.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.610+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f53f4059100 con 0x7f53fc15d6e0 2024-01-27T14:32:37.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.620+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f53f4055440 con 0x7f53fc15d6e0 2024-01-27T14:32:37.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.800+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53fc0742e0 con 0x7f53fc15d6e0 2024-01-27T14:32:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.854+0000 7f53e3fff640 1 -- 172.21.15.46:0/468851071 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f53f4018070 con 0x7f53fc15d6e0 2024-01-27T14:32:37.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:37.852 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.856+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 msgr2=0x7f53e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 0x7f53e806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009c00 tx=0x7f53ec009190 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 msgr2=0x7f53fc15b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53f400ef00 tx=0x7f53f400b480 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 shutdown_connections 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f53e806aed0 0x7f53e806d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc15d6e0 0x7f53fc15b1f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53fc153ac0 0x7f53fc158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 --2- 172.21.15.46:0/468851071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53fc0cf7c0 0x7f53fc15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 >> 172.21.15.46:0/468851071 conn(0x7f53fc06cca0 msgr2=0x7f53fc0b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 shutdown_connections 2024-01-27T14:32:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.857+0000 7f5401ece640 1 -- 172.21.15.46:0/468851071 wait complete. 2024-01-27T14:32:37.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:32:37.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:32:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.972+0000 7f39936ca640 1 Processor -- start 2024-01-27T14:32:37.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 -- start start 2024-01-27T14:32:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f398c0cbdf0 0x7f398c08af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0ca820 con 0x7f398c08b4a0 2024-01-27T14:32:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0ca3d0 con 0x7f398c0cbdf0 2024-01-27T14:32:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.973+0000 7f39936ca640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0c9e10 con 0x7f398c153b60 2024-01-27T14:32:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.974+0000 7f3990c65640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f398c0cbdf0 0x7f398c08af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.974+0000 7f3991466640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.974+0000 7f3991466640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57434/0 (socket says 172.21.15.46:57434) 2024-01-27T14:32:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.974+0000 7f3991466640 1 -- 172.21.15.46:0/1903709856 learned_addr learned my addr 172.21.15.46:0/1903709856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.976+0000 7f3991466640 1 -- 172.21.15.46:0/1903709856 >> v2:172.21.15.46:3300/0 conn(0x7f398c0cbdf0 msgr2=0x7f398c08af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.976+0000 7f3991466640 1 --2- 172.21.15.46:0/1903709856 >> v2:172.21.15.46:3300/0 conn(0x7f398c0cbdf0 0x7f398c08af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.976+0000 7f3991466640 1 -- 172.21.15.46:0/1903709856 >> v1:172.21.15.46:6789/0 conn(0x7f398c08b4a0 legacy=0x7f398c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.977+0000 7f3991466640 1 -- 172.21.15.46:0/1903709856 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0ca0f0 con 0x7f398c153b60 2024-01-27T14:32:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.979+0000 7f3991466640 1 --2- 172.21.15.46:0/1903709856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3984009870 tx=0x7f398402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d46c3270c52b423 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.982+0000 7f398bfff640 1 -- 172.21.15.46:0/1903709856 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984030840 con 0x7f398c153b60 2024-01-27T14:32:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.982+0000 7f398bfff640 1 -- 172.21.15.46:0/1903709856 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840309a0 con 0x7f398c153b60 2024-01-27T14:32:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.982+0000 7f398bfff640 1 -- 172.21.15.46:0/1903709856 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984030d30 con 0x7f398c153b60 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 -- 172.21.15.46:0/1903709856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 msgr2=0x7f398c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 --2- 172.21.15.46:0/1903709856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3984009870 tx=0x7f398402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 -- 172.21.15.46:0/1903709856 shutdown_connections 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 --2- 172.21.15.46:0/1903709856 >> v2:172.21.15.46:3300/0 conn(0x7f398c0cbdf0 0x7f398c08af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 --2- 172.21.15.46:0/1903709856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c153b60 0x7f398c15a3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 -- 172.21.15.46:0/1903709856 >> 172.21.15.46:0/1903709856 conn(0x7f398c071df0 msgr2=0x7f398c072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 -- 172.21.15.46:0/1903709856 shutdown_connections 2024-01-27T14:32:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.983+0000 7f39936ca640 1 -- 172.21.15.46:0/1903709856 wait complete. 2024-01-27T14:32:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.984+0000 7f39936ca640 1 Processor -- start 2024-01-27T14:32:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.984+0000 7f39936ca640 1 -- start start 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 0x7f398c1ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c0cbdf0 0x7f398c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 0x7f398c1f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1e0b20 con 0x7f398c153b60 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1e0d70 con 0x7f398c08b4a0 2024-01-27T14:32:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f39936ca640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1e1050 con 0x7f398c0cbdf0 2024-01-27T14:32:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.985+0000 7f3991c67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 0x7f398c1f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.986+0000 7f3991466640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 0x7f398c1ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.986+0000 7f3990c65640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c0cbdf0 0x7f398c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.986+0000 7f3991c67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 0x7f398c1f0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35546/0 (socket says 172.21.15.46:35546) 2024-01-27T14:32:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.986+0000 7f3991c67640 1 -- 172.21.15.46:0/3430668833 learned_addr learned my addr 172.21.15.46:0/3430668833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.989+0000 7f3991466640 1 -- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c0cbdf0 msgr2=0x7f398c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.989+0000 7f3991466640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c0cbdf0 0x7f398c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.989+0000 7f3991466640 1 -- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 msgr2=0x7f398c1f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.989+0000 7f3991466640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 0x7f398c1f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.989+0000 7f3991466640 1 -- 172.21.15.46:0/3430668833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840094d0 con 0x7f398c08b4a0 2024-01-27T14:32:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.991+0000 7f3991466640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 0x7f398c1ef4f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3984033000 tx=0x7f3984004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.995+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984039a90 con 0x7f398c08b4a0 2024-01-27T14:32:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.995+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984039c10 con 0x7f398c08b4a0 2024-01-27T14:32:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.995+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984043410 con 0x7f398c08b4a0 2024-01-27T14:32:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.995+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1e1330 con 0x7f398c08b4a0 2024-01-27T14:32:37.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.996+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c1e18f0 con 0x7f398c08b4a0 2024-01-27T14:32:37.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:37.996+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c0742e0 con 0x7f398c08b4a0 2024-01-27T14:32:38.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.015+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f398404c3b0 con 0x7f398c08b4a0 2024-01-27T14:32:38.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.016+0000 7f3989ffb640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 0x7f397806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.016+0000 7f3990c65640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 0x7f397806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.016+0000 7f3990c65640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 0x7f397806d3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f398c1f0620 tx=0x7f3980009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:38.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.018+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f398407a9c0 con 0x7f398c08b4a0 2024-01-27T14:32:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.255+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3984076d00 con 0x7f398c08b4a0 2024-01-27T14:32:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.435+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f398c0ca9e0 con 0x7f398c08b4a0 2024-01-27T14:32:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.441+0000 7f3989ffb640 1 -- 172.21.15.46:0/3430668833 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39840340a0 con 0x7f398c08b4a0 2024-01-27T14:32:38.437 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:32:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 msgr2=0x7f397806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 0x7f397806d3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f398c1f0620 tx=0x7f3980009190 comp rx=0 tx=0).stop 2024-01-27T14:32:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 msgr2=0x7f398c1ef4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 0x7f398c1ef4f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3984033000 tx=0x7f3984004730 comp rx=0 tx=0).stop 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 shutdown_connections 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f397806af20 0x7f397806d3e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f398c153b60 0x7f398c1f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f398c0cbdf0 0x7f398c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 --2- 172.21.15.46:0/3430668833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c08b4a0 0x7f398c1ef4f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 >> 172.21.15.46:0/3430668833 conn(0x7f398c071df0 msgr2=0x7f398c0cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 shutdown_connections 2024-01-27T14:32:38.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.442+0000 7f39936ca640 1 -- 172.21.15.46:0/3430668833 wait complete. 2024-01-27T14:32:38.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:32:38.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.557+0000 7f08930f3640 1 Processor -- start 2024-01-27T14:32:38.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.557+0000 7f08930f3640 1 -- start start 2024-01-27T14:32:38.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.558+0000 7f08930f3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f088c15a3c0 0x7f088c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.558+0000 7f08930f3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c0cc730 con 0x7f088c153a20 2024-01-27T14:32:38.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.558+0000 7f08930f3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c06bed0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.558+0000 7f08930f3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c06cdc0 con 0x7f088c15a3c0 2024-01-27T14:32:38.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.559+0000 7f088bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f088c15a3c0 0x7f088c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.559+0000 7f0891690640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f088c0cc2c0 0x7f088c0b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46822/0 (socket says 172.21.15.46:46822) 2024-01-27T14:32:38.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.559+0000 7f0891690640 1 -- 172.21.15.46:0/447522905 learned_addr learned my addr 172.21.15.46:0/447522905 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:38.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.561+0000 7f088b7fe640 1 -- 172.21.15.46:0/447522905 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108619015 0 0) 0x7f088c06bed0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.561+0000 7f088b7fe640 1 -- 172.21.15.46:0/447522905 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0874003520 con 0x7f088c0cc2c0 2024-01-27T14:32:38.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.562+0000 7f088bfff640 1 -- 172.21.15.46:0/447522905 >> v1:172.21.15.73:6789/0 conn(0x7f088c0cc2c0 legacy=0x7f088c0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.562+0000 7f088bfff640 1 -- 172.21.15.46:0/447522905 >> v1:172.21.15.46:6789/0 conn(0x7f088c153a20 legacy=0x7f088c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.562+0000 7f088bfff640 1 -- 172.21.15.46:0/447522905 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c06c1b0 con 0x7f088c15a3c0 2024-01-27T14:32:38.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.565+0000 7f088bfff640 1 --2- 172.21.15.46:0/447522905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c0cbd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08800097a0 tx=0x7f088002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b696b0f3e679f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:38.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.570+0000 7f088b7fe640 1 -- 172.21.15.46:0/447522905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088002f810 con 0x7f088c15a3c0 2024-01-27T14:32:38.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.570+0000 7f088b7fe640 1 -- 172.21.15.46:0/447522905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088002f970 con 0x7f088c15a3c0 2024-01-27T14:32:38.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.570+0000 7f088b7fe640 1 -- 172.21.15.46:0/447522905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088002fd00 con 0x7f088c15a3c0 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 -- 172.21.15.46:0/447522905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 msgr2=0x7f088c0cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 --2- 172.21.15.46:0/447522905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c0cbd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08800097a0 tx=0x7f088002b9f0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 -- 172.21.15.46:0/447522905 shutdown_connections 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 --2- 172.21.15.46:0/447522905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c0cbd80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 -- 172.21.15.46:0/447522905 >> 172.21.15.46:0/447522905 conn(0x7f088c071fd0 msgr2=0x7f088c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 -- 172.21.15.46:0/447522905 shutdown_connections 2024-01-27T14:32:38.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.571+0000 7f08930f3640 1 -- 172.21.15.46:0/447522905 wait complete. 2024-01-27T14:32:38.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.572+0000 7f08930f3640 1 Processor -- start 2024-01-27T14:32:38.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.572+0000 7f08930f3640 1 -- start start 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 0x7f088c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f088c153a20 0x7f088c1efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15c960 con 0x7f088c15a3c0 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15da30 con 0x7f088c0cc2c0 2024-01-27T14:32:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f08930f3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c1ef360 con 0x7f088c153a20 2024-01-27T14:32:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.573+0000 7f0891690640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.574+0000 7f0890e8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 0x7f088c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.574+0000 7f088bfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f088c153a20 0x7f088c1efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.574+0000 7f0891690640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c1491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35562/0 (socket says 172.21.15.46:35562) 2024-01-27T14:32:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.574+0000 7f0891690640 1 -- 172.21.15.46:0/2827757782 learned_addr learned my addr 172.21.15.46:0/2827757782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.577+0000 7f0890e8f640 1 -- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f088c153a20 msgr2=0x7f088c1efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.577+0000 7f0890e8f640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f088c153a20 0x7f088c1efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.577+0000 7f0890e8f640 1 -- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 msgr2=0x7f088c1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.577+0000 7f0890e8f640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.577+0000 7f0890e8f640 1 -- 172.21.15.46:0/2827757782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880009400 con 0x7f088c0cc2c0 2024-01-27T14:32:38.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.579+0000 7f0890e8f640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 0x7f088c15d4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c370 tx=0x7f087c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:38.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.583+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0052d0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.583+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c005450 con 0x7f088c0cc2c0 2024-01-27T14:32:38.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.583+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c007260 con 0x7f088c0cc2c0 2024-01-27T14:32:38.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.583+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c1ef8c0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.584+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c155c60 con 0x7f088c0cc2c0 2024-01-27T14:32:38.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.584+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c0742e0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.832+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f087c0073c0 con 0x7f088c0cc2c0 2024-01-27T14:32:38.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.832+0000 7f08897fa640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 0x7f087806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:38.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.832+0000 7f088bfff640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 0x7f087806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:38.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.833+0000 7f088bfff640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 0x7f087806d410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0880036000 tx=0x7f0880008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:38.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.836+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f087c057a40 con 0x7f088c0cc2c0 2024-01-27T14:32:38.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:38.848+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f087c053d80 con 0x7f088c0cc2c0 2024-01-27T14:32:39.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.043+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f088c0ce480 con 0x7f088c0cc2c0 2024-01-27T14:32:39.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.049+0000 7f08897fa640 1 -- 172.21.15.46:0/2827757782 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f087c0200a0 con 0x7f088c0cc2c0 2024-01-27T14:32:39.046 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 msgr2=0x7f087806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 0x7f087806d410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0880036000 tx=0x7f0880008030 comp rx=0 tx=0).stop 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 msgr2=0x7f088c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 0x7f088c15d4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c370 tx=0x7f087c00c830 comp rx=0 tx=0).stop 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 shutdown_connections 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f087806af50 0x7f087806d410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f088c15a3c0 0x7f088c1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f088c153a20 0x7f088c1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 --2- 172.21.15.46:0/2827757782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f088c0cc2c0 0x7f088c15d4f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 >> 172.21.15.46:0/2827757782 conn(0x7f088c071fd0 msgr2=0x7f088c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 shutdown_connections 2024-01-27T14:32:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.051+0000 7f08930f3640 1 -- 172.21.15.46:0/2827757782 wait complete. 2024-01-27T14:32:39.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:32:39.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.166+0000 7fc3770da640 1 Processor -- start 2024-01-27T14:32:39.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.166+0000 7fc3770da640 1 -- start start 2024-01-27T14:32:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.167+0000 7fc3770da640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc370153a30 0x7fc3700c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.167+0000 7fc3770da640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3700cc000 0x7fc3700ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.167+0000 7fc3770da640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3700ca8e0 con 0x7fc370153e10 2024-01-27T14:32:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.167+0000 7fc3770da640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3700cb460 con 0x7fc370153a30 2024-01-27T14:32:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.167+0000 7fc3770da640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37015a6b0 con 0x7fc3700cc000 2024-01-27T14:32:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.168+0000 7fc374e76640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc370153a30 0x7fc3700c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.168+0000 7fc375677640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3700cc000 0x7fc3700ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.168+0000 7fc36ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc370153e10 0x7fc3700cb8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46836/0 (socket says 172.21.15.46:46836) 2024-01-27T14:32:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.168+0000 7fc374e76640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc370153a30 0x7fc3700c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35572/0 (socket says 172.21.15.46:35572) 2024-01-27T14:32:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.168+0000 7fc36ffff640 1 -- 172.21.15.46:0/3773878535 learned_addr learned my addr 172.21.15.46:0/3773878535 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.170+0000 7fc374e76640 1 -- 172.21.15.46:0/3773878535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3700cc000 msgr2=0x7fc3700ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.170+0000 7fc374e76640 1 --2- 172.21.15.46:0/3773878535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3700cc000 0x7fc3700ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.170+0000 7fc374e76640 1 -- 172.21.15.46:0/3773878535 >> v1:172.21.15.73:6789/0 conn(0x7fc370153e10 legacy=0x7fc3700cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.170+0000 7fc374e76640 1 -- 172.21.15.46:0/3773878535 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700cab30 con 0x7fc370153a30 2024-01-27T14:32:39.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.172+0000 7fc374e76640 1 --2- 172.21.15.46:0/3773878535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153a30 0x7fc3700c9e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc368009d90 tx=0x7fc36802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e749cb701e72ddc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.176+0000 7fc36f7fe640 1 -- 172.21.15.46:0/3773878535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36802cc50 con 0x7fc370153a30 2024-01-27T14:32:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.176+0000 7fc36f7fe640 1 -- 172.21.15.46:0/3773878535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36802cdb0 con 0x7fc370153a30 2024-01-27T14:32:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.176+0000 7fc36f7fe640 1 -- 172.21.15.46:0/3773878535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368034660 con 0x7fc370153a30 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 -- 172.21.15.46:0/3773878535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153a30 msgr2=0x7fc3700c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 --2- 172.21.15.46:0/3773878535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153a30 0x7fc3700c9e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc368009d90 tx=0x7fc36802bea0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 -- 172.21.15.46:0/3773878535 shutdown_connections 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 --2- 172.21.15.46:0/3773878535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3700cc000 0x7fc3700ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 --2- 172.21.15.46:0/3773878535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153a30 0x7fc3700c9e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 -- 172.21.15.46:0/3773878535 >> 172.21.15.46:0/3773878535 conn(0x7fc370071df0 msgr2=0x7fc370072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 -- 172.21.15.46:0/3773878535 shutdown_connections 2024-01-27T14:32:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.177+0000 7fc3770da640 1 -- 172.21.15.46:0/3773878535 wait complete. 2024-01-27T14:32:39.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.178+0000 7fc3770da640 1 Processor -- start 2024-01-27T14:32:39.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.178+0000 7fc3770da640 1 -- start start 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3700cc000 0x7fc370152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc370153a30 0x7fc370155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc370154d90 con 0x7fc370153e10 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701eecc0 con 0x7fc3700cc000 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc3770da640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37014dfd0 con 0x7fc370153a30 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc375677640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.179+0000 7fc374e76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3700cc000 0x7fc370152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.180+0000 7fc375677640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35586/0 (socket says 172.21.15.46:35586) 2024-01-27T14:32:39.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.180+0000 7fc375677640 1 -- 172.21.15.46:0/63383309 learned_addr learned my addr 172.21.15.46:0/63383309 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:39.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.180+0000 7fc36ffff640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc370153a30 0x7fc370155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.183+0000 7fc375677640 1 -- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc370153a30 msgr2=0x7fc370155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.183+0000 7fc375677640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc370153a30 0x7fc370155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.183+0000 7fc375677640 1 -- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3700cc000 msgr2=0x7fc370152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.183+0000 7fc375677640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3700cc000 0x7fc370152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.183+0000 7fc375677640 1 -- 172.21.15.46:0/63383309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368009a70 con 0x7fc370153e10 2024-01-27T14:32:39.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.186+0000 7fc375677640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e930 tx=0x7fc36000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.189+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360009690 con 0x7fc370153e10 2024-01-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.189+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000c920 con 0x7fc370153e10 2024-01-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.189+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000ccd0 con 0x7fc370153e10 2024-01-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.189+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3701547d0 con 0x7fc370153e10 2024-01-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.189+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3701eeed0 con 0x7fc370153e10 2024-01-27T14:32:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.190+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3700742e0 con 0x7fc370153e10 2024-01-27T14:32:39.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.454+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc360013470 con 0x7fc370153e10 2024-01-27T14:32:39.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.455+0000 7fc36d7fa640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 0x7fc35c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.455+0000 7fc374e76640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 0x7fc35c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.456+0000 7fc374e76640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 0x7fc35c06d3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc368036000 tx=0x7fc368030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.468+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc360058830 con 0x7fc370153e10 2024-01-27T14:32:39.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.469+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc360054b70 con 0x7fc370153e10 2024-01-27T14:32:39.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.649+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc370155a60 con 0x7fc370153e10 2024-01-27T14:32:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.654+0000 7fc36d7fa640 1 -- 172.21.15.46:0/63383309 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc360021020 con 0x7fc370153e10 2024-01-27T14:32:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 msgr2=0x7fc35c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 0x7fc35c06d3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc368036000 tx=0x7fc368030000 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 msgr2=0x7fc3701589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e930 tx=0x7fc36000edf0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 shutdown_connections 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc35c06af20 0x7fc35c06d3e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc370153e10 0x7fc3701589e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc370153a30 0x7fc370155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 --2- 172.21.15.46:0/63383309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3700cc000 0x7fc370152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 >> 172.21.15.46:0/63383309 conn(0x7fc370071df0 msgr2=0x7fc3700c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 shutdown_connections 2024-01-27T14:32:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.657+0000 7fc3770da640 1 -- 172.21.15.46:0/63383309 wait complete. 2024-01-27T14:32:39.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:32:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.772+0000 7f8d9eeee640 1 Processor -- start 2024-01-27T14:32:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.772+0000 7f8d9eeee640 1 -- start start 2024-01-27T14:32:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.773+0000 7f8d9eeee640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8d9808bf30 0x7f8d980cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.773+0000 7f8d9eeee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980caa20 con 0x7f8d98153b90 2024-01-27T14:32:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.773+0000 7f8d9eeee640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d98153f70 con 0x7f8d980c9b70 2024-01-27T14:32:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.773+0000 7f8d9eeee640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980c5e70 con 0x7f8d9808bf30 2024-01-27T14:32:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.774+0000 7f8d9cc8a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8d98153b90 0x7f8d980cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45336/0 (socket says 172.21.15.46:45336) 2024-01-27T14:32:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.774+0000 7f8d9cc8a640 1 -- 172.21.15.46:0/3476780074 learned_addr learned my addr 172.21.15.46:0/3476780074 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.774+0000 7f8d97fff640 1 --2- 172.21.15.46:0/3476780074 >> v2:172.21.15.73:3300/0 conn(0x7f8d9808bf30 0x7f8d980cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.776+0000 7f8d977fe640 1 -- 172.21.15.46:0/3476780074 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209196384 0 0) 0x7f8d90001490 con 0x7f8d98153b90 2024-01-27T14:32:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.776+0000 7f8d977fe640 1 -- 172.21.15.46:0/3476780074 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d80003520 con 0x7f8d98153b90 2024-01-27T14:32:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.777+0000 7f8d97fff640 1 -- 172.21.15.46:0/3476780074 >> v1:172.21.15.73:6789/0 conn(0x7f8d980c9b70 legacy=0x7f8d9815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.777+0000 7f8d97fff640 1 -- 172.21.15.46:0/3476780074 >> v1:172.21.15.46:6789/0 conn(0x7f8d98153b90 legacy=0x7f8d980cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.777+0000 7f8d97fff640 1 -- 172.21.15.46:0/3476780074 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98159960 con 0x7f8d9808bf30 2024-01-27T14:32:39.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.782+0000 7f8d97fff640 1 --2- 172.21.15.46:0/3476780074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d980cc600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0097a0 tx=0x7f8d8c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a533eb7355f450 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.786+0000 7f8d977fe640 1 -- 172.21.15.46:0/3476780074 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c02f810 con 0x7f8d9808bf30 2024-01-27T14:32:39.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.786+0000 7f8d977fe640 1 -- 172.21.15.46:0/3476780074 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c02f970 con 0x7f8d9808bf30 2024-01-27T14:32:39.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.786+0000 7f8d977fe640 1 -- 172.21.15.46:0/3476780074 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c02fd00 con 0x7f8d9808bf30 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3476780074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 msgr2=0x7f8d980cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3476780074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d980cc600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0097a0 tx=0x7f8d8c02b9f0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3476780074 shutdown_connections 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3476780074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d980cc600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3476780074 >> 172.21.15.46:0/3476780074 conn(0x7f8d98066ac0 msgr2=0x7f8d9806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3476780074 shutdown_connections 2024-01-27T14:32:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.787+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3476780074 wait complete. 2024-01-27T14:32:39.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.788+0000 7f8d9eeee640 1 Processor -- start 2024-01-27T14:32:39.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.788+0000 7f8d9eeee640 1 -- start start 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d98154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d980c9b70 0x7f8d981ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98154670 con 0x7f8d98153b90 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98155750 con 0x7f8d9808bf30 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9eeee640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980b3780 con 0x7f8d980c9b70 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9d48b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d9cc8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d98154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.789+0000 7f8d97fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d980c9b70 0x7f8d981ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.790+0000 7f8d9d48b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35594/0 (socket says 172.21.15.46:35594) 2024-01-27T14:32:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.790+0000 7f8d9d48b640 1 -- 172.21.15.46:0/3231599592 learned_addr learned my addr 172.21.15.46:0/3231599592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.793+0000 7f8d9d48b640 1 -- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d980c9b70 msgr2=0x7f8d981ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.793+0000 7f8d9d48b640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d980c9b70 0x7f8d981ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.793+0000 7f8d9d48b640 1 -- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 msgr2=0x7f8d98154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.793+0000 7f8d9d48b640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d98154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.793+0000 7f8d9d48b640 1 -- 172.21.15.46:0/3231599592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009400 con 0x7f8d98153b90 2024-01-27T14:32:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.795+0000 7f8d9d48b640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d88001eb0 tx=0x7f8d8800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.799+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880052d0 con 0x7f8d98153b90 2024-01-27T14:32:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.799+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88005430 con 0x7f8d98153b90 2024-01-27T14:32:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.799+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88003810 con 0x7f8d98153b90 2024-01-27T14:32:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.799+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980b3a40 con 0x7f8d98153b90 2024-01-27T14:32:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.799+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d981f3340 con 0x7f8d98153b90 2024-01-27T14:32:39.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.800+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d981f2ec0 con 0x7f8d98153b90 2024-01-27T14:32:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.819+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d88003970 con 0x7f8d98153b90 2024-01-27T14:32:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.819+0000 7f8d957fa640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.820+0000 7f8d9cc8a640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.820+0000 7f8d9cc8a640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 0x7f8d8406d410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d90005c00 tx=0x7f8d90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:39.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:39.824+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8d88057a50 con 0x7f8d98153b90 2024-01-27T14:32:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.082+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8d88053d90 con 0x7f8d98153b90 2024-01-27T14:32:40.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.265+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d981f2ec0 con 0x7f8d98153b90 2024-01-27T14:32:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.270+0000 7f8d957fa640 1 -- 172.21.15.46:0/3231599592 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d981f2ec0 con 0x7f8d98153b90 2024-01-27T14:32:40.267 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 msgr2=0x7f8d8406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 0x7f8d8406d410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d90005c00 tx=0x7f8d90009040 comp rx=0 tx=0).stop 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 msgr2=0x7f8d9815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d88001eb0 tx=0x7f8d8800c890 comp rx=0 tx=0).stop 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 shutdown_connections 2024-01-27T14:32:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d98153b90 0x7f8d9815c390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d980c9b70 0x7f8d981ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 --2- 172.21.15.46:0/3231599592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d9808bf30 0x7f8d98154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 >> 172.21.15.46:0/3231599592 conn(0x7f8d98066ac0 msgr2=0x7f8d98152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 shutdown_connections 2024-01-27T14:32:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.272+0000 7f8d9eeee640 1 -- 172.21.15.46:0/3231599592 wait complete. 2024-01-27T14:32:40.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:32:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 Processor -- start 2024-01-27T14:32:40.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 -- start start 2024-01-27T14:32:40.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 0x7fdafc165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:40.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc153f60 con 0x7fdafc153b80 2024-01-27T14:32:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0cb190 con 0x7fdafc0c6660 2024-01-27T14:32:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.385+0000 7fdb0150f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc15dc90 con 0x7fdafc0cc050 2024-01-27T14:32:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.386+0000 7fdafb7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 0x7fdafc165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.386+0000 7fdafaffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdafc153b80 0x7fdafc1597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45342/0 (socket says 172.21.15.46:45342) 2024-01-27T14:32:40.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.386+0000 7fdafaffd640 1 -- 172.21.15.46:0/1334408386 learned_addr learned my addr 172.21.15.46:0/1334408386 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527976048 0 0) 0x7fdafc0cb190 con 0x7fdafc0c6660 2024-01-27T14:32:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae8003520 con 0x7fdafc0c6660 2024-01-27T14:32:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922112830 0 0) 0x7fdafc153f60 con 0x7fdafc153b80 2024-01-27T14:32:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc0cb190 con 0x7fdafc153b80 2024-01-27T14:32:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdafb7fe640 1 -- 172.21.15.46:0/1334408386 >> v1:172.21.15.73:6789/0 conn(0x7fdafc0c6660 legacy=0x7fdafc0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdafb7fe640 1 -- 172.21.15.46:0/1334408386 >> v1:172.21.15.46:6789/0 conn(0x7fdafc153b80 legacy=0x7fdafc1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.388+0000 7fdafb7fe640 1 -- 172.21.15.46:0/1334408386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0caeb0 con 0x7fdafc0cc050 2024-01-27T14:32:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.390+0000 7fdafb7fe640 1 --2- 172.21.15.46:0/1334408386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 0x7fdafc165120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009dc0 tx=0x7fdaec02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89563d5cd4566aa7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.394+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec02ccd0 con 0x7fdafc0cc050 2024-01-27T14:32:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.394+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec02ce30 con 0x7fdafc0cc050 2024-01-27T14:32:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.394+0000 7fdaf9ffb640 1 -- 172.21.15.46:0/1334408386 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec034660 con 0x7fdafc0cc050 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 -- 172.21.15.46:0/1334408386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 msgr2=0x7fdafc165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 --2- 172.21.15.46:0/1334408386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 0x7fdafc165120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009dc0 tx=0x7fdaec02bf20 comp rx=0 tx=0).stop 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 -- 172.21.15.46:0/1334408386 shutdown_connections 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 --2- 172.21.15.46:0/1334408386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc0cc050 0x7fdafc165120 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 -- 172.21.15.46:0/1334408386 >> 172.21.15.46:0/1334408386 conn(0x7fdafc071df0 msgr2=0x7fdafc072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 -- 172.21.15.46:0/1334408386 shutdown_connections 2024-01-27T14:32:40.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.395+0000 7fdb0150f640 1 -- 172.21.15.46:0/1334408386 wait complete. 2024-01-27T14:32:40.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.396+0000 7fdb0150f640 1 Processor -- start 2024-01-27T14:32:40.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.396+0000 7fdb0150f640 1 -- start start 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 0x7fdafc1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 0x7fdafc15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc14b5a0 con 0x7fdafc0cc050 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0bd960 con 0x7fdafc0c6660 2024-01-27T14:32:40.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdb0150f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc1465e0 con 0x7fdafc153b80 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.397+0000 7fdafa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.398+0000 7fdafb7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 0x7fdafc15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.398+0000 7fdafaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 0x7fdafc1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.398+0000 7fdafa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35598/0 (socket says 172.21.15.46:35598) 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.398+0000 7fdafaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 0x7fdafc1f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50818/0 (socket says 172.21.15.46:50818) 2024-01-27T14:32:40.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.398+0000 7fdafa7fc640 1 -- 172.21.15.46:0/4004648466 learned_addr learned my addr 172.21.15.46:0/4004648466 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafb7fe640 1 -- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 msgr2=0x7fdafc1f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafb7fe640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 0x7fdafc1f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafb7fe640 1 -- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 msgr2=0x7fdafc155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafb7fe640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafb7fe640 1 -- 172.21.15.46:0/4004648466 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec009a70 con 0x7fdafc153b80 2024-01-27T14:32:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.401+0000 7fdafa7fc640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.403+0000 7fdafb7fe640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 0x7fdafc15bce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdaec033000 tx=0x7fdaec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.407+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec03d600 con 0x7fdafc153b80 2024-01-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.407+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec03d760 con 0x7fdafc153b80 2024-01-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.407+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec03db10 con 0x7fdafc153b80 2024-01-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.407+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc1f2730 con 0x7fdafc153b80 2024-01-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.407+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc154ed0 con 0x7fdafc153b80 2024-01-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.408+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc155060 con 0x7fdafc153b80 2024-01-27T14:32:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.427+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdaec03b040 con 0x7fdafc153b80 2024-01-27T14:32:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.427+0000 7fdaf37fe640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 0x7fdadc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.428+0000 7fdafaffd640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 0x7fdadc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:40.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.428+0000 7fdafaffd640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 0x7fdadc06d3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4005880 tx=0x7fdaf4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:40.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.650+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fdaec07a850 con 0x7fdafc153b80 2024-01-27T14:32:40.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.662+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdaec076b90 con 0x7fdafc153b80 2024-01-27T14:32:40.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.881+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdafc0742e0 con 0x7fdafc153b80 2024-01-27T14:32:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.906+0000 7fdaf37fe640 1 -- 172.21.15.46:0/4004648466 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6578 (secure 0 0 0) 0x7fdaec044090 con 0x7fdafc153b80 2024-01-27T14:32:40.903 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:40.903 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:33.202914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253,"mds_3":4250,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:32:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.907+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 msgr2=0x7fdadc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.907+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 0x7fdadc06d3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4005880 tx=0x7fdaf4009040 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.907+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 msgr2=0x7fdafc15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.907+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 0x7fdafc15bce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdaec033000 tx=0x7fdaec004a40 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 shutdown_connections 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdadc06af20 0x7fdadc06d3e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdafc153b80 0x7fdafc15bce0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdafc0cc050 0x7fdafc155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 --2- 172.21.15.46:0/4004648466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdafc0c6660 0x7fdafc1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 >> 172.21.15.46:0/4004648466 conn(0x7fdafc071df0 msgr2=0x7fdafc0721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 shutdown_connections 2024-01-27T14:32:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:40.908+0000 7fdb0150f640 1 -- 172.21.15.46:0/4004648466 wait complete. 2024-01-27T14:32:40.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.020+0000 7f7e07d1d640 1 Processor -- start 2024-01-27T14:32:41.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.020+0000 7f7e07d1d640 1 -- start start 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.021+0000 7f7e07d1d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 0x7f7e000c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.021+0000 7f7e07d1d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e000c8350 0x7f7e0015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.021+0000 7f7e07d1d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0006c6e0 con 0x7f7e00153a90 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.021+0000 7f7e07d1d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0015da30 con 0x7f7e000c8350 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.021+0000 7f7e07d1d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015dcf0 con 0x7f7e0006baf0 2024-01-27T14:32:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.022+0000 7f7e052b8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 0x7f7e000c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.022+0000 7f7e05ab9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7e00153a90 0x7f7e0006bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:46866/0 (socket says 172.21.15.46:46866) 2024-01-27T14:32:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.022+0000 7f7e05ab9640 1 -- 172.21.15.46:0/1654100470 learned_addr learned my addr 172.21.15.46:0/1654100470 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e04ab7640 1 -- 172.21.15.46:0/1654100470 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570934169 0 0) 0x7f7e0006c6e0 con 0x7f7e00153a90 2024-01-27T14:32:41.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e04ab7640 1 -- 172.21.15.46:0/1654100470 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dec003520 con 0x7f7e00153a90 2024-01-27T14:32:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e052b8640 1 -- 172.21.15.46:0/1654100470 >> v2:172.21.15.46:3300/0 conn(0x7f7e000c8350 msgr2=0x7f7e0015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e052b8640 1 --2- 172.21.15.46:0/1654100470 >> v2:172.21.15.46:3300/0 conn(0x7f7e000c8350 0x7f7e0015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e052b8640 1 -- 172.21.15.46:0/1654100470 >> v1:172.21.15.73:6789/0 conn(0x7f7e00153a90 legacy=0x7f7e0006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.024+0000 7f7e052b8640 1 -- 172.21.15.46:0/1654100470 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00159930 con 0x7f7e0006baf0 2024-01-27T14:32:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.026+0000 7f7e052b8640 1 --2- 172.21.15.46:0/1654100470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 0x7f7e000c7e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fcbf16ced7fe8f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.029+0000 7f7e04ab7640 1 -- 172.21.15.46:0/1654100470 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031830 con 0x7f7e0006baf0 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.029+0000 7f7e04ab7640 1 -- 172.21.15.46:0/1654100470 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc031990 con 0x7f7e0006baf0 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.029+0000 7f7e04ab7640 1 -- 172.21.15.46:0/1654100470 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031d20 con 0x7f7e0006baf0 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 -- 172.21.15.46:0/1654100470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 msgr2=0x7f7e000c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/1654100470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 0x7f7e000c7e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02b8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 -- 172.21.15.46:0/1654100470 shutdown_connections 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/1654100470 >> v2:172.21.15.46:3300/0 conn(0x7f7e000c8350 0x7f7e0015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/1654100470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e0006baf0 0x7f7e000c7e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 -- 172.21.15.46:0/1654100470 >> 172.21.15.46:0/1654100470 conn(0x7f7e00070e40 msgr2=0x7f7e00071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 -- 172.21.15.46:0/1654100470 shutdown_connections 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.030+0000 7f7e07d1d640 1 -- 172.21.15.46:0/1654100470 wait complete. 2024-01-27T14:32:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.031+0000 7f7e07d1d640 1 Processor -- start 2024-01-27T14:32:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.031+0000 7f7e07d1d640 1 -- start start 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e0006baf0 0x7f7e00158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 0x7f7e001ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001476f0 con 0x7f7e0006baf0 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001563e0 con 0x7f7e00153a90 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e07d1d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001f27a0 con 0x7f7e000c8350 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e062ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 0x7f7e001ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.032+0000 7f7e052b8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.033+0000 7f7e05ab9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e0006baf0 0x7f7e00158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.033+0000 7f7e052b8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57534/0 (socket says 172.21.15.46:57534) 2024-01-27T14:32:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.033+0000 7f7e062ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 0x7f7e001ef8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:50826/0 (socket says 172.21.15.46:50826) 2024-01-27T14:32:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.033+0000 7f7e052b8640 1 -- 172.21.15.46:0/4292457709 learned_addr learned my addr 172.21.15.46:0/4292457709 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.036+0000 7f7e052b8640 1 -- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 msgr2=0x7f7e001ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.036+0000 7f7e052b8640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 0x7f7e001ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.036+0000 7f7e052b8640 1 -- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e0006baf0 msgr2=0x7f7e00158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.036+0000 7f7e052b8640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e0006baf0 0x7f7e00158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.036+0000 7f7e052b8640 1 -- 172.21.15.46:0/4292457709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009400 con 0x7f7e000c8350 2024-01-27T14:32:41.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.038+0000 7f7e052b8640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0098c0 tx=0x7f7dfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.042+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc03b970 con 0x7f7e000c8350 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.042+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc03baf0 con 0x7f7e000c8350 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.042+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e001f2a40 con 0x7f7e000c8350 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.042+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc03bea0 con 0x7f7e000c8350 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.042+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e001531f0 con 0x7f7e000c8350 2024-01-27T14:32:41.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.043+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e001f2bd0 con 0x7f7e000c8350 2024-01-27T14:32:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.060+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7dfc04e450 con 0x7f7e000c8350 2024-01-27T14:32:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.061+0000 7f7df67fc640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 0x7f7de406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.061+0000 7f7e05ab9640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 0x7f7de406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.061+0000 7f7e05ab9640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 0x7f7de406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005880 tx=0x7f7df0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.064+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7dfc07a7c0 con 0x7f7e000c8350 2024-01-27T14:32:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.299+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7dfc076b00 con 0x7f7e000c8350 2024-01-27T14:32:41.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.490+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e000742e0 con 0x7f7e000c8350 2024-01-27T14:32:41.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.531+0000 7f7df67fc640 1 -- 172.21.15.46:0/4292457709 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f7dfc035020 con 0x7f7e000c8350 2024-01-27T14:32:41.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:41.529 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 msgr2=0x7f7de406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 0x7f7de406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005880 tx=0x7f7df0009040 comp rx=0 tx=0).stop 2024-01-27T14:32:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 msgr2=0x7f7e001f2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0098c0 tx=0x7f7dfc0046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 shutdown_connections 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7de406aed0 0x7f7de406d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e00153a90 0x7f7e001ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e000c8350 0x7f7e001f2ed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 --2- 172.21.15.46:0/4292457709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e0006baf0 0x7f7e00158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 >> 172.21.15.46:0/4292457709 conn(0x7f7e00070e40 msgr2=0x7f7e000c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 shutdown_connections 2024-01-27T14:32:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.533+0000 7f7e07d1d640 1 -- 172.21.15.46:0/4292457709 wait complete. 2024-01-27T14:32:41.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:32:41.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:32:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.658+0000 7f1fd13f8640 1 Processor -- start 2024-01-27T14:32:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.658+0000 7f1fd13f8640 1 -- start start 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1fcc153c00 0x7f1fcc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1fcc0cf880 0x7f1fcc0b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0c4f40 con 0x7f1fcc0cf880 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc15a7a0 con 0x7f1fcc153c00 2024-01-27T14:32:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fd13f8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0c4070 con 0x7f1fcc0c9950 2024-01-27T14:32:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fca7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.659+0000 7f1fcb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1fcc0cf880 0x7f1fcc0b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.660+0000 7f1fcaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1fcc153c00 0x7f1fcc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.660+0000 7f1fca7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57544/0 (socket says 172.21.15.46:57544) 2024-01-27T14:32:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.660+0000 7f1fca7fc640 1 -- 172.21.15.46:0/2366964284 learned_addr learned my addr 172.21.15.46:0/2366964284 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:41.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.662+0000 7f1fca7fc640 1 -- 172.21.15.46:0/2366964284 >> v2:172.21.15.73:3300/0 conn(0x7f1fcc153c00 msgr2=0x7f1fcc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:41.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.662+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/2366964284 >> v2:172.21.15.73:3300/0 conn(0x7f1fcc153c00 0x7f1fcc15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.662+0000 7f1fca7fc640 1 -- 172.21.15.46:0/2366964284 >> v2:172.21.15.46:3300/0 conn(0x7f1fcc0cf880 msgr2=0x7f1fcc0b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:41.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.662+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/2366964284 >> v2:172.21.15.46:3300/0 conn(0x7f1fcc0cf880 0x7f1fcc0b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.662+0000 7f1fca7fc640 1 -- 172.21.15.46:0/2366964284 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0c4330 con 0x7f1fcc0c9950 2024-01-27T14:32:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.664+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/2366964284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cfee0 tx=0x7f1fc002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f627c0b4ff1e21f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.667+0000 7f1fc9ffb640 1 -- 172.21.15.46:0/2366964284 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0031870 con 0x7f1fcc0c9950 2024-01-27T14:32:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.667+0000 7f1fc9ffb640 1 -- 172.21.15.46:0/2366964284 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00319d0 con 0x7f1fcc0c9950 2024-01-27T14:32:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.667+0000 7f1fc9ffb640 1 -- 172.21.15.46:0/2366964284 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0031d60 con 0x7f1fcc0c9950 2024-01-27T14:32:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 -- 172.21.15.46:0/2366964284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 msgr2=0x7f1fcc0cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/2366964284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cfee0 tx=0x7f1fc002b910 comp rx=0 tx=0).stop 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 -- 172.21.15.46:0/2366964284 shutdown_connections 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/2366964284 >> v2:172.21.15.46:3300/0 conn(0x7f1fcc0cf880 0x7f1fcc0b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/2366964284 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0c9950 0x7f1fcc0cf340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/2366964284 >> v2:172.21.15.73:3300/0 conn(0x7f1fcc153c00 0x7f1fcc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 -- 172.21.15.46:0/2366964284 >> 172.21.15.46:0/2366964284 conn(0x7f1fcc06cca0 msgr2=0x7f1fcc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 -- 172.21.15.46:0/2366964284 shutdown_connections 2024-01-27T14:32:41.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.668+0000 7f1fd13f8640 1 -- 172.21.15.46:0/2366964284 wait complete. 2024-01-27T14:32:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.669+0000 7f1fd13f8640 1 Processor -- start 2024-01-27T14:32:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.669+0000 7f1fd13f8640 1 -- start start 2024-01-27T14:32:41.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc0c9950 0x7f1fcc158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 0x7f1fcc158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc158190 con 0x7f1fcc153c00 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1efda0 con 0x7f1fcc0c9950 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.670+0000 7f1fd13f8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1594b0 con 0x7f1fcc0cf880 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.671+0000 7f1fcb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.671+0000 7f1fca7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 0x7f1fcc158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.671+0000 7f1fcaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc0c9950 0x7f1fcc158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.671+0000 7f1fcb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35640/0 (socket says 172.21.15.46:35640) 2024-01-27T14:32:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.671+0000 7f1fcb7fe640 1 -- 172.21.15.46:0/1937726472 learned_addr learned my addr 172.21.15.46:0/1937726472 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fca7fc640 1 -- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc0c9950 msgr2=0x7f1fcc158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc0c9950 0x7f1fcc158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fca7fc640 1 -- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 msgr2=0x7f1fcc1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fca7fc640 1 -- 172.21.15.46:0/1937726472 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094d0 con 0x7f1fcc0cf880 2024-01-27T14:32:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.674+0000 7f1fcb7fe640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.677+0000 7f1fca7fc640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 0x7f1fcc158390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0033000 tx=0x7f1fc00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.681+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc003ac60 con 0x7f1fcc0cf880 2024-01-27T14:32:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.681+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc003adc0 con 0x7f1fcc0cf880 2024-01-27T14:32:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.681+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0044630 con 0x7f1fcc0cf880 2024-01-27T14:32:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.681+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc157930 con 0x7f1fcc0cf880 2024-01-27T14:32:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.681+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc157bd0 con 0x7f1fcc0cf880 2024-01-27T14:32:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.682+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc0742e0 con 0x7f1fcc0cf880 2024-01-27T14:32:41.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.701+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1fc004d450 con 0x7f1fcc0cf880 2024-01-27T14:32:41.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.702+0000 7f1fb37fe640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 0x7f1fb806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:41.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.702+0000 7f1fcaffd640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 0x7f1fb806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:41.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.702+0000 7f1fcaffd640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 0x7f1fb806d3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40113e0 tx=0x7f1fc400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.705+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1fc002d040 con 0x7f1fcc0cf880 2024-01-27T14:32:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:41.940+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1fc0076a40 con 0x7f1fcc0cf880 2024-01-27T14:32:42.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.127+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fcc0cc870 con 0x7f1fcc0cf880 2024-01-27T14:32:42.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.132+0000 7f1fb37fe640 1 -- 172.21.15.46:0/1937726472 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fc007a060 con 0x7f1fcc0cf880 2024-01-27T14:32:42.129 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 msgr2=0x7f1fb806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 0x7f1fb806d3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40113e0 tx=0x7f1fc400b040 comp rx=0 tx=0).stop 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 msgr2=0x7f1fcc158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 0x7f1fcc158390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0033000 tx=0x7f1fc00046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 shutdown_connections 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1fb806af20 0x7f1fb806d3e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc153c00 0x7f1fcc1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1fcc0cf880 0x7f1fcc158390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 --2- 172.21.15.46:0/1937726472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc0c9950 0x7f1fcc158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 >> 172.21.15.46:0/1937726472 conn(0x7f1fcc06cca0 msgr2=0x7f1fcc1515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:42.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 shutdown_connections 2024-01-27T14:32:42.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.134+0000 7f1fd13f8640 1 -- 172.21.15.46:0/1937726472 wait complete. 2024-01-27T14:32:42.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:32:42.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 Processor -- start 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 -- start start 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7930153b50 0x7f793008bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f793015a130 0x7f79300cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300c3e90 con 0x7f79300cf800 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79300c9ce0 con 0x7f793015a130 2024-01-27T14:32:42.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.249+0000 7f793606e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79300c4150 con 0x7f7930153b50 2024-01-27T14:32:42.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.250+0000 7f792f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7930153b50 0x7f793008bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.250+0000 7f792effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f793015a130 0x7f79300cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.250+0000 7f792effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f793015a130 0x7f79300cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35646/0 (socket says 172.21.15.46:35646) 2024-01-27T14:32:42.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.250+0000 7f792effd640 1 -- 172.21.15.46:0/3615553250 learned_addr learned my addr 172.21.15.46:0/3615553250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:42.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.253+0000 7f792effd640 1 -- 172.21.15.46:0/3615553250 >> v2:172.21.15.73:3300/0 conn(0x7f7930153b50 msgr2=0x7f793008bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:42.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.253+0000 7f792effd640 1 --2- 172.21.15.46:0/3615553250 >> v2:172.21.15.73:3300/0 conn(0x7f7930153b50 0x7f793008bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.253+0000 7f792effd640 1 -- 172.21.15.46:0/3615553250 >> v1:172.21.15.73:6789/0 conn(0x7f79300cf800 legacy=0x7f793015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.253+0000 7f792effd640 1 -- 172.21.15.46:0/3615553250 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300c4430 con 0x7f793015a130 2024-01-27T14:32:42.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.255+0000 7f792effd640 1 --2- 172.21.15.46:0/3615553250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015a130 0x7f79300cf2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f793008bab0 tx=0x7f792002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f242ec1c462ea060 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.258+0000 7f792e7fc640 1 -- 172.21.15.46:0/3615553250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792002f850 con 0x7f793015a130 2024-01-27T14:32:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.258+0000 7f792e7fc640 1 -- 172.21.15.46:0/3615553250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792002f9b0 con 0x7f793015a130 2024-01-27T14:32:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.258+0000 7f792e7fc640 1 -- 172.21.15.46:0/3615553250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792002fd40 con 0x7f793015a130 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 -- 172.21.15.46:0/3615553250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015a130 msgr2=0x7f79300cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 --2- 172.21.15.46:0/3615553250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015a130 0x7f79300cf2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f793008bab0 tx=0x7f792002ba30 comp rx=0 tx=0).stop 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 -- 172.21.15.46:0/3615553250 shutdown_connections 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 --2- 172.21.15.46:0/3615553250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f793015a130 0x7f79300cf2c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 --2- 172.21.15.46:0/3615553250 >> v2:172.21.15.73:3300/0 conn(0x7f7930153b50 0x7f793008bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 -- 172.21.15.46:0/3615553250 >> 172.21.15.46:0/3615553250 conn(0x7f793006cca0 msgr2=0x7f793006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:42.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 -- 172.21.15.46:0/3615553250 shutdown_connections 2024-01-27T14:32:42.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.259+0000 7f793606e640 1 -- 172.21.15.46:0/3615553250 wait complete. 2024-01-27T14:32:42.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.260+0000 7f793606e640 1 Processor -- start 2024-01-27T14:32:42.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.260+0000 7f793606e640 1 -- start start 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 0x7f7930153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7930153b50 0x7f7930149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 0x7f7930156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301590c0 con 0x7f79300cf800 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793014a260 con 0x7f793015a130 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.261+0000 7f793606e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79301570c0 con 0x7f7930153b50 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.262+0000 7f792f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 0x7f7930153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.262+0000 7f792ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 0x7f7930156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.262+0000 7f792effd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7930153b50 0x7f7930149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.262+0000 7f792f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 0x7f7930153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35650/0 (socket says 172.21.15.46:35650) 2024-01-27T14:32:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.262+0000 7f792f7fe640 1 -- 172.21.15.46:0/242093469 learned_addr learned my addr 172.21.15.46:0/242093469 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.265+0000 7f792ffff640 1 -- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7930153b50 msgr2=0x7f7930149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.265+0000 7f792ffff640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7930153b50 0x7f7930149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.265+0000 7f792ffff640 1 -- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 msgr2=0x7f7930153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.265+0000 7f792ffff640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 0x7f7930153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.265+0000 7f792ffff640 1 -- 172.21.15.46:0/242093469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200094d0 con 0x7f793015a130 2024-01-27T14:32:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.267+0000 7f792ffff640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 0x7f7930156b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f792800c700 tx=0x7f792800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.271+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928003b70 con 0x7f793015a130 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.271+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928003cd0 con 0x7f793015a130 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.271+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7930154610 con 0x7f793015a130 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.271+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928005310 con 0x7f793015a130 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.271+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79301595f0 con 0x7f793015a130 2024-01-27T14:32:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.272+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300742e0 con 0x7f793015a130 2024-01-27T14:32:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.289+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7928005470 con 0x7f793015a130 2024-01-27T14:32:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.290+0000 7f7917fff640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 0x7f791c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.290+0000 7f792f7fe640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 0x7f791c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.290+0000 7f792f7fe640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 0x7f791c06d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7924009c00 tx=0x7f7924009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:42.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.292+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f79280588c0 con 0x7f793015a130 2024-01-27T14:32:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.524+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7928054c00 con 0x7f793015a130 2024-01-27T14:32:42.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.706+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f793015d7c0 con 0x7f793015a130 2024-01-27T14:32:42.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.712+0000 7f7917fff640 1 -- 172.21.15.46:0/242093469 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7928058220 con 0x7f793015a130 2024-01-27T14:32:42.708 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:42.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 msgr2=0x7f791c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 0x7f791c06d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7924009c00 tx=0x7f7924009190 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 msgr2=0x7f7930156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 0x7f7930156b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f792800c700 tx=0x7f792800cbc0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 shutdown_connections 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f791c06af20 0x7f791c06d3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f793015a130 0x7f7930156b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7930153b50 0x7f7930149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 --2- 172.21.15.46:0/242093469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79300cf800 0x7f7930153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 >> 172.21.15.46:0/242093469 conn(0x7f793006cca0 msgr2=0x7f79300cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 shutdown_connections 2024-01-27T14:32:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.714+0000 7f793606e640 1 -- 172.21.15.46:0/242093469 wait complete. 2024-01-27T14:32:42.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:32:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 Processor -- start 2024-01-27T14:32:42.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 -- start start 2024-01-27T14:32:42.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54f0153e10 0x7f54f00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe30 0x7f54f01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00ca8e0 con 0x7f54f0153a30 2024-01-27T14:32:42.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f00cb460 con 0x7f54f0153e10 2024-01-27T14:32:42.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.829+0000 7f54f653e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00cc2c0 con 0x7f54f00cbe30 2024-01-27T14:32:42.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.830+0000 7f54ef7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54f0153e10 0x7f54f00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.830+0000 7f54effff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f54f0153a30 0x7f54f00c9e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45348/0 (socket says 172.21.15.46:45348) 2024-01-27T14:32:42.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.830+0000 7f54effff640 1 -- 172.21.15.46:0/4172130176 learned_addr learned my addr 172.21.15.46:0/4172130176 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:42.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.830+0000 7f54f4adb640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe30 0x7f54f01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.833+0000 7f54ef7fe640 1 -- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe30 msgr2=0x7f54f01598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.833+0000 7f54ef7fe640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe30 0x7f54f01598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.833+0000 7f54ef7fe640 1 -- 172.21.15.46:0/4172130176 >> v1:172.21.15.46:6789/0 conn(0x7f54f0153a30 legacy=0x7f54f00c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.833+0000 7f54ef7fe640 1 -- 172.21.15.46:0/4172130176 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f015a6b0 con 0x7f54f0153e10 2024-01-27T14:32:42.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.836+0000 7f54ef7fe640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f00cb8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54e40097a0 tx=0x7f54e402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb872203bb7b633d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.841+0000 7f54eeffd640 1 -- 172.21.15.46:0/4172130176 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4031830 con 0x7f54f0153e10 2024-01-27T14:32:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.841+0000 7f54eeffd640 1 -- 172.21.15.46:0/4172130176 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4031990 con 0x7f54f0153e10 2024-01-27T14:32:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.841+0000 7f54eeffd640 1 -- 172.21.15.46:0/4172130176 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4031d20 con 0x7f54f0153e10 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 -- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 msgr2=0x7f54f00cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f00cb8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54e40097a0 tx=0x7f54e402b8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 -- 172.21.15.46:0/4172130176 shutdown_connections 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe30 0x7f54f01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 --2- 172.21.15.46:0/4172130176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f00cb8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 -- 172.21.15.46:0/4172130176 >> 172.21.15.46:0/4172130176 conn(0x7f54f0071df0 msgr2=0x7f54f0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 -- 172.21.15.46:0/4172130176 shutdown_connections 2024-01-27T14:32:42.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.842+0000 7f54f653e640 1 -- 172.21.15.46:0/4172130176 wait complete. 2024-01-27T14:32:42.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.843+0000 7f54f653e640 1 Processor -- start 2024-01-27T14:32:42.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.843+0000 7f54f653e640 1 -- start start 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 0x7f54f01ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f01ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0155220 con 0x7f54f00cbe30 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00c5ac0 con 0x7f54f0153e10 2024-01-27T14:32:42.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.844+0000 7f54f653e640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f01546c0 con 0x7f54f0153a30 2024-01-27T14:32:42.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.845+0000 7f54effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.845+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 0x7f54f01ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.845+0000 7f54effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35664/0 (socket says 172.21.15.46:35664) 2024-01-27T14:32:42.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.845+0000 7f54effff640 1 -- 172.21.15.46:0/3995175167 learned_addr learned my addr 172.21.15.46:0/3995175167 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:42.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.845+0000 7f54f4adb640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f01ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54ef7fe640 1 -- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 msgr2=0x7f54f01ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54ef7fe640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f01ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54ef7fe640 1 -- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 msgr2=0x7f54f015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54ef7fe640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54ef7fe640 1 -- 172.21.15.46:0/3995175167 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4009400 con 0x7f54f0153a30 2024-01-27T14:32:42.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.848+0000 7f54effff640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:42.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.851+0000 7f54ef7fe640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 0x7f54f01ef140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54e4033000 tx=0x7f54e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:42.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.854+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e403a9e0 con 0x7f54f0153a30 2024-01-27T14:32:42.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.855+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e403ab60 con 0x7f54f0153a30 2024-01-27T14:32:42.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.855+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40423f0 con 0x7f54f0153a30 2024-01-27T14:32:42.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.855+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f0154f40 con 0x7f54f0153a30 2024-01-27T14:32:42.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.855+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f0154350 con 0x7f54f0153a30 2024-01-27T14:32:42.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.856+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f0154850 con 0x7f54f0153a30 2024-01-27T14:32:42.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.874+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f54e404b450 con 0x7f54f0153a30 2024-01-27T14:32:42.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.875+0000 7f54ecff9640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:42.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.875+0000 7f54effff640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:42.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:42.875+0000 7f54effff640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 0x7f54dc06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54e0004e60 tx=0x7f54e0007f10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.103+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f54e407a260 con 0x7f54f0153a30 2024-01-27T14:32:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.117+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f54e40765a0 con 0x7f54f0153a30 2024-01-27T14:32:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.297+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54f00742e0 con 0x7f54f0153a30 2024-01-27T14:32:43.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.303+0000 7f54ecff9640 1 -- 172.21.15.46:0/3995175167 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54e4035020 con 0x7f54f0153a30 2024-01-27T14:32:43.299 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.304+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 msgr2=0x7f54dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.304+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 0x7f54dc06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54e0004e60 tx=0x7f54e0007f10 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 msgr2=0x7f54f01ef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 0x7f54f01ef140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54e4033000 tx=0x7f54e40046c0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 shutdown_connections 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f0153e10 0x7f54f01ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f0153a30 0x7f54f01ef140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 --2- 172.21.15.46:0/3995175167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f00cbe30 0x7f54f015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 >> 172.21.15.46:0/3995175167 conn(0x7f54f0071df0 msgr2=0x7f54f00c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 shutdown_connections 2024-01-27T14:32:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.305+0000 7f54f653e640 1 -- 172.21.15.46:0/3995175167 wait complete. 2024-01-27T14:32:43.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:32:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.419+0000 7f5cecc77640 1 Processor -- start 2024-01-27T14:32:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.419+0000 7f5cecc77640 1 -- start start 2024-01-27T14:32:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.420+0000 7f5cecc77640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ce8153b60 0x7f5ce815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.420+0000 7f5cecc77640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80ca820 con 0x7f5ce80cbdf0 2024-01-27T14:32:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.420+0000 7f5cecc77640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80ca3d0 con 0x7f5ce808b670 2024-01-27T14:32:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.420+0000 7f5cecc77640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce80c9e10 con 0x7f5ce8153b60 2024-01-27T14:32:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.421+0000 7f5ce5d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5ce80cbdf0 0x7f5ce808af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45356/0 (socket says 172.21.15.46:45356) 2024-01-27T14:32:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.421+0000 7f5ce5d9b640 1 -- 172.21.15.46:0/2309409632 learned_addr learned my addr 172.21.15.46:0/2309409632 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.421+0000 7f5ce659c640 1 --2- 172.21.15.46:0/2309409632 >> v2:172.21.15.73:3300/0 conn(0x7f5ce8153b60 0x7f5ce815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.423+0000 7f5ce559a640 1 -- 172.21.15.46:0/2309409632 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357362901 0 0) 0x7f5ce80ca820 con 0x7f5ce80cbdf0 2024-01-27T14:32:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.423+0000 7f5ce559a640 1 -- 172.21.15.46:0/2309409632 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd4003520 con 0x7f5ce80cbdf0 2024-01-27T14:32:43.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.424+0000 7f5ce659c640 1 -- 172.21.15.46:0/2309409632 >> v1:172.21.15.73:6789/0 conn(0x7f5ce808b670 legacy=0x7f5ce81641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.424+0000 7f5ce659c640 1 -- 172.21.15.46:0/2309409632 >> v1:172.21.15.46:6789/0 conn(0x7f5ce80cbdf0 legacy=0x7f5ce808af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.424+0000 7f5ce659c640 1 -- 172.21.15.46:0/2309409632 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80ca0f0 con 0x7f5ce8153b60 2024-01-27T14:32:43.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.429+0000 7f5ce659c640 1 --2- 172.21.15.46:0/2309409632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce815a3a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097a0 tx=0x7f5ce002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb51e3b50d5ab5f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:43.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.433+0000 7f5ce559a640 1 -- 172.21.15.46:0/2309409632 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0030610 con 0x7f5ce8153b60 2024-01-27T14:32:43.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.433+0000 7f5ce559a640 1 -- 172.21.15.46:0/2309409632 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0030770 con 0x7f5ce8153b60 2024-01-27T14:32:43.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.433+0000 7f5ce559a640 1 -- 172.21.15.46:0/2309409632 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0030b00 con 0x7f5ce8153b60 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.433+0000 7f5cecc77640 1 -- 172.21.15.46:0/2309409632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 msgr2=0x7f5ce815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.433+0000 7f5cecc77640 1 --2- 172.21.15.46:0/2309409632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce815a3a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097a0 tx=0x7f5ce002b960 comp rx=0 tx=0).stop 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.434+0000 7f5cecc77640 1 -- 172.21.15.46:0/2309409632 shutdown_connections 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.434+0000 7f5cecc77640 1 --2- 172.21.15.46:0/2309409632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce815a3a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.434+0000 7f5cecc77640 1 -- 172.21.15.46:0/2309409632 >> 172.21.15.46:0/2309409632 conn(0x7f5ce8071df0 msgr2=0x7f5ce8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.434+0000 7f5cecc77640 1 -- 172.21.15.46:0/2309409632 shutdown_connections 2024-01-27T14:32:43.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.434+0000 7f5cecc77640 1 -- 172.21.15.46:0/2309409632 wait complete. 2024-01-27T14:32:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.435+0000 7f5cecc77640 1 Processor -- start 2024-01-27T14:32:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.435+0000 7f5cecc77640 1 -- start start 2024-01-27T14:32:43.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 0x7f5ce80c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ce80cbdf0 0x7f5ce8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80c41b0 con 0x7f5ce808b670 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce814bf70 con 0x7f5ce8153b60 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5cecc77640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce8151fa0 con 0x7f5ce80cbdf0 2024-01-27T14:32:43.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5ce659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 0x7f5ce80c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5ce6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5ce5d9b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ce80cbdf0 0x7f5ce8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5ce659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 0x7f5ce80c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35678/0 (socket says 172.21.15.46:35678) 2024-01-27T14:32:43.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.436+0000 7f5ce659c640 1 -- 172.21.15.46:0/3936884592 learned_addr learned my addr 172.21.15.46:0/3936884592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:43.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.440+0000 7f5ce6d9d640 1 -- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ce80cbdf0 msgr2=0x7f5ce8152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.440+0000 7f5ce6d9d640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ce80cbdf0 0x7f5ce8152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.440+0000 7f5ce6d9d640 1 -- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 msgr2=0x7f5ce80c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.440+0000 7f5ce6d9d640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 0x7f5ce80c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.440+0000 7f5ce6d9d640 1 -- 172.21.15.46:0/3936884592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0009400 con 0x7f5ce8153b60 2024-01-27T14:32:43.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.442+0000 7f5ce6d9d640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce814a9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c690 tx=0x7f5cd800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:43.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.446+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8003b70 con 0x7f5ce8153b60 2024-01-27T14:32:43.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.446+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8003cd0 con 0x7f5ce8153b60 2024-01-27T14:32:43.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.446+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8005310 con 0x7f5ce8153b60 2024-01-27T14:32:43.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.446+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8151c50 con 0x7f5ce8153b60 2024-01-27T14:32:43.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.446+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce814c1c0 con 0x7f5ce8153b60 2024-01-27T14:32:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.447+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce8152110 con 0x7f5ce8153b60 2024-01-27T14:32:43.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.466+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5cd8005470 con 0x7f5ce8153b60 2024-01-27T14:32:43.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.466+0000 7f5cdeffd640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 0x7f5cc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:43.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.466+0000 7f5ce659c640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 0x7f5cc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:43.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.467+0000 7f5ce659c640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 0x7f5cc806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ce002b9a0 tx=0x7f5ce003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:43.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.469+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5cd8058a20 con 0x7f5ce8153b60 2024-01-27T14:32:43.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.703+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5cd8054d60 con 0x7f5ce8153b60 2024-01-27T14:32:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.883+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ce80c8f90 con 0x7f5ce8153b60 2024-01-27T14:32:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.900+0000 7f5cdeffd640 1 -- 172.21.15.46:0/3936884592 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cd8058380 con 0x7f5ce8153b60 2024-01-27T14:32:43.897 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:32:43.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 msgr2=0x7f5cc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 0x7f5cc806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ce002b9a0 tx=0x7f5ce003b040 comp rx=0 tx=0).stop 2024-01-27T14:32:43.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 msgr2=0x7f5ce814a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:43.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce814a9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c690 tx=0x7f5cd800cb50 comp rx=0 tx=0).stop 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 shutdown_connections 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cc806aed0 0x7f5cc806d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce8153b60 0x7f5ce814a9f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ce80cbdf0 0x7f5ce8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 --2- 172.21.15.46:0/3936884592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce808b670 0x7f5ce80c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 >> 172.21.15.46:0/3936884592 conn(0x7f5ce8071df0 msgr2=0x7f5ce81580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 shutdown_connections 2024-01-27T14:32:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:43.902+0000 7f5cecc77640 1 -- 172.21.15.46:0/3936884592 wait complete. 2024-01-27T14:32:43.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:32:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.015+0000 7f803f583640 1 Processor -- start 2024-01-27T14:32:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.015+0000 7f803f583640 1 -- start start 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803f583640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803f583640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f803806c630 0x7f8038159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803f583640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8038153e10 con 0x7f80380cd360 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803f583640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803806ba90 con 0x7f803806c630 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803f583640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803815cce0 con 0x7f8038153a30 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803db20640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f803806c630 0x7f8038159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.016+0000 7f803d31f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.017+0000 7f803d31f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:57584/0 (socket says 172.21.15.46:57584) 2024-01-27T14:32:44.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.017+0000 7f803d31f640 1 -- 172.21.15.46:0/4053821757 learned_addr learned my addr 172.21.15.46:0/4053821757 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.019+0000 7f803d31f640 1 -- 172.21.15.46:0/4053821757 >> v2:172.21.15.46:3300/0 conn(0x7f803806c630 msgr2=0x7f8038159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.019+0000 7f803d31f640 1 --2- 172.21.15.46:0/4053821757 >> v2:172.21.15.46:3300/0 conn(0x7f803806c630 0x7f8038159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.019+0000 7f803d31f640 1 -- 172.21.15.46:0/4053821757 >> v1:172.21.15.46:6789/0 conn(0x7f80380cd360 legacy=0x7f803806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.019+0000 7f803d31f640 1 -- 172.21.15.46:0/4053821757 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803815cf80 con 0x7f8038153a30 2024-01-27T14:32:44.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.021+0000 7f803d31f640 1 --2- 172.21.15.46:0/4053821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9415bfe7efba4e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.024+0000 7f802ffff640 1 -- 172.21.15.46:0/4053821757 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034030840 con 0x7f8038153a30 2024-01-27T14:32:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.024+0000 7f802ffff640 1 -- 172.21.15.46:0/4053821757 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80340309a0 con 0x7f8038153a30 2024-01-27T14:32:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.024+0000 7f802ffff640 1 -- 172.21.15.46:0/4053821757 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034030d30 con 0x7f8038153a30 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 -- 172.21.15.46:0/4053821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 msgr2=0x7f80380cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 --2- 172.21.15.46:0/4053821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 -- 172.21.15.46:0/4053821757 shutdown_connections 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 --2- 172.21.15.46:0/4053821757 >> v2:172.21.15.46:3300/0 conn(0x7f803806c630 0x7f8038159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 --2- 172.21.15.46:0/4053821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8038153a30 0x7f80380cce20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 -- 172.21.15.46:0/4053821757 >> 172.21.15.46:0/4053821757 conn(0x7f803806a6c0 msgr2=0x7f803806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 -- 172.21.15.46:0/4053821757 shutdown_connections 2024-01-27T14:32:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.025+0000 7f803f583640 1 -- 172.21.15.46:0/4053821757 wait complete. 2024-01-27T14:32:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.026+0000 7f803f583640 1 Processor -- start 2024-01-27T14:32:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.026+0000 7f803f583640 1 -- start start 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f803806c630 0x7f803815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80380cd360 0x7f80381e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803814bd70 con 0x7f8038153a30 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803815c500 con 0x7f80380cd360 2024-01-27T14:32:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.027+0000 7f803f583640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803815c750 con 0x7f803806c630 2024-01-27T14:32:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.028+0000 7f803db20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.028+0000 7f803d31f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f803806c630 0x7f803815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.028+0000 7f803db20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35698/0 (socket says 172.21.15.46:35698) 2024-01-27T14:32:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.028+0000 7f803db20640 1 -- 172.21.15.46:0/1240808218 learned_addr learned my addr 172.21.15.46:0/1240808218 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.028+0000 7f803cb1e640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80380cd360 0x7f80381e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.031+0000 7f803db20640 1 -- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f803806c630 msgr2=0x7f803815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.031+0000 7f803db20640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f803806c630 0x7f803815adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.031+0000 7f803db20640 1 -- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80380cd360 msgr2=0x7f80381e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.031+0000 7f803db20640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80380cd360 0x7f80381e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.031+0000 7f803db20640 1 -- 172.21.15.46:0/1240808218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094d0 con 0x7f8038153a30 2024-01-27T14:32:44.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.033+0000 7f803db20640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f803000efc0 tx=0x7f803000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.037+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030014480 con 0x7f8038153a30 2024-01-27T14:32:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.037+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000f040 con 0x7f8038153a30 2024-01-27T14:32:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.037+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030014820 con 0x7f8038153a30 2024-01-27T14:32:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.037+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803815bd90 con 0x7f8038153a30 2024-01-27T14:32:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.037+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803814c110 con 0x7f8038153a30 2024-01-27T14:32:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.038+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803806d960 con 0x7f8038153a30 2024-01-27T14:32:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.058+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8030014980 con 0x7f8038153a30 2024-01-27T14:32:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.058+0000 7f802dffb640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 0x7f801c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.058+0000 7f803d31f640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 0x7f801c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.059+0000 7f803d31f640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 0x7f801c06d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8034036000 tx=0x7f8034008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.061+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8030059590 con 0x7f8038153a30 2024-01-27T14:32:44.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.318+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f80300558d0 con 0x7f8038153a30 2024-01-27T14:32:44.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.537+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f803815bf80 con 0x7f8038153a30 2024-01-27T14:32:44.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.550+0000 7f802dffb640 1 -- 172.21.15.46:0/1240808218 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6578 (secure 0 0 0) 0x7f8030018020 con 0x7f8038153a30 2024-01-27T14:32:44.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:44.548 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:33.202914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253,"mds_3":4250,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:32:44.548 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.552+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 msgr2=0x7f801c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.552+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 0x7f801c06d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8034036000 tx=0x7f8034008030 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 msgr2=0x7f803814dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f803000efc0 tx=0x7f803000c490 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 shutdown_connections 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f801c06af50 0x7f801c06d410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80380cd360 0x7f80381e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8038153a30 0x7f803814dce0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 --2- 172.21.15.46:0/1240808218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f803806c630 0x7f803815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 >> 172.21.15.46:0/1240808218 conn(0x7f803806a6c0 msgr2=0x7f8038070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 shutdown_connections 2024-01-27T14:32:44.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.553+0000 7f803f583640 1 -- 172.21.15.46:0/1240808218 wait complete. 2024-01-27T14:32:44.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:32:44.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.665+0000 7fea46e1c640 1 Processor -- start 2024-01-27T14:32:44.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.665+0000 7fea46e1c640 1 -- start start 2024-01-27T14:32:44.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.666+0000 7fea46e1c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fea4006baf0 0x7fea400c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.666+0000 7fea46e1c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea400c8350 0x7fea4015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.666+0000 7fea46e1c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4006c6e0 con 0x7fea40153a90 2024-01-27T14:32:44.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.666+0000 7fea46e1c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4015da30 con 0x7fea400c8350 2024-01-27T14:32:44.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.666+0000 7fea46e1c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4015dcf0 con 0x7fea4006baf0 2024-01-27T14:32:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.667+0000 7fea453b9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea400c8350 0x7fea4015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.667+0000 7fea3ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fea4006baf0 0x7fea400c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.667+0000 7fea3ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fea4006baf0 0x7fea400c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40534/0 (socket says 172.21.15.46:40534) 2024-01-27T14:32:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.667+0000 7fea3ffff640 1 -- 172.21.15.46:0/1258493033 learned_addr learned my addr 172.21.15.46:0/1258493033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.670+0000 7fea3ffff640 1 -- 172.21.15.46:0/1258493033 >> v2:172.21.15.46:3300/0 conn(0x7fea400c8350 msgr2=0x7fea4015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.670+0000 7fea3ffff640 1 --2- 172.21.15.46:0/1258493033 >> v2:172.21.15.46:3300/0 conn(0x7fea400c8350 0x7fea4015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.670+0000 7fea3ffff640 1 -- 172.21.15.46:0/1258493033 >> v1:172.21.15.46:6789/0 conn(0x7fea40153a90 legacy=0x7fea4006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.670+0000 7fea3ffff640 1 -- 172.21.15.46:0/1258493033 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40159930 con 0x7fea4006baf0 2024-01-27T14:32:44.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.672+0000 7fea3ffff640 1 --2- 172.21.15.46:0/1258493033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea400c7e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea40072ba0 tx=0x7fea3002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c05055f2b34d118 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea3f7fe640 1 -- 172.21.15.46:0/1258493033 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30030860 con 0x7fea4006baf0 2024-01-27T14:32:44.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea3f7fe640 1 -- 172.21.15.46:0/1258493033 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300309c0 con 0x7fea4006baf0 2024-01-27T14:32:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea3f7fe640 1 -- 172.21.15.46:0/1258493033 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30030d50 con 0x7fea4006baf0 2024-01-27T14:32:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 -- 172.21.15.46:0/1258493033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 msgr2=0x7fea400c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 --2- 172.21.15.46:0/1258493033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea400c7e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea40072ba0 tx=0x7fea3002b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 -- 172.21.15.46:0/1258493033 shutdown_connections 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 --2- 172.21.15.46:0/1258493033 >> v2:172.21.15.46:3300/0 conn(0x7fea400c8350 0x7fea4015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 --2- 172.21.15.46:0/1258493033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea400c7e10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 -- 172.21.15.46:0/1258493033 >> 172.21.15.46:0/1258493033 conn(0x7fea40070e40 msgr2=0x7fea40071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 -- 172.21.15.46:0/1258493033 shutdown_connections 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.676+0000 7fea46e1c640 1 -- 172.21.15.46:0/1258493033 wait complete. 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 Processor -- start 2024-01-27T14:32:44.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 -- start start 2024-01-27T14:32:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea401f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea400c8350 0x7fea400c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015ae80 con 0x7fea40153a90 2024-01-27T14:32:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015b0b0 con 0x7fea4006baf0 2024-01-27T14:32:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.678+0000 7fea46e1c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea40159330 con 0x7fea400c8350 2024-01-27T14:32:44.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.679+0000 7fea453b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.679+0000 7fea44bb8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea401f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.679+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea400c8350 0x7fea400c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.679+0000 7fea453b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59938/0 (socket says 172.21.15.46:59938) 2024-01-27T14:32:44.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.679+0000 7fea453b9640 1 -- 172.21.15.46:0/2365872160 learned_addr learned my addr 172.21.15.46:0/2365872160 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:44.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.683+0000 7fea453b9640 1 -- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea400c8350 msgr2=0x7fea400c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.683+0000 7fea453b9640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea400c8350 0x7fea400c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.683+0000 7fea453b9640 1 -- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 msgr2=0x7fea401f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:44.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.683+0000 7fea453b9640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea401f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:44.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.683+0000 7fea453b9640 1 -- 172.21.15.46:0/2365872160 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300094d0 con 0x7fea40153a90 2024-01-27T14:32:44.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.685+0000 7fea453b9640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea2800e930 tx=0x7fea2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.689+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28009690 con 0x7fea40153a90 2024-01-27T14:32:44.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.689+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800c980 con 0x7fea40153a90 2024-01-27T14:32:44.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.689+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4015b370 con 0x7fea40153a90 2024-01-27T14:32:44.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.689+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800cd30 con 0x7fea40153a90 2024-01-27T14:32:44.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.689+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea40159050 con 0x7fea40153a90 2024-01-27T14:32:44.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.690+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4006d930 con 0x7fea40153a90 2024-01-27T14:32:44.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.956+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fea28013470 con 0x7fea40153a90 2024-01-27T14:32:44.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.957+0000 7fea3d7fa640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 0x7fea2006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:44.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.957+0000 7fea44bb8640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 0x7fea2006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:44.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.957+0000 7fea44bb8640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 0x7fea2006d3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea38001e70 tx=0x7fea38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:44.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.969+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fea28058c80 con 0x7fea40153a90 2024-01-27T14:32:44.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:44.970+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fea28054fc0 con 0x7fea40153a90 2024-01-27T14:32:45.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.168+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea400742e0 con 0x7fea40153a90 2024-01-27T14:32:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.209+0000 7fea3d7fa640 1 -- 172.21.15.46:0/2365872160 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7fea28021020 con 0x7fea40153a90 2024-01-27T14:32:45.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:45.206 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:32:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 msgr2=0x7fea2006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 0x7fea2006d3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea38001e70 tx=0x7fea38009040 comp rx=0 tx=0).stop 2024-01-27T14:32:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 msgr2=0x7fea400c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea2800e930 tx=0x7fea2800edf0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 shutdown_connections 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fea2006af20 0x7fea2006d3e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea40153a90 0x7fea400c34a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea400c8350 0x7fea400c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 --2- 172.21.15.46:0/2365872160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea4006baf0 0x7fea401f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 >> 172.21.15.46:0/2365872160 conn(0x7fea40070e40 msgr2=0x7fea4006c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 shutdown_connections 2024-01-27T14:32:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.211+0000 7fea46e1c640 1 -- 172.21.15.46:0/2365872160 wait complete. 2024-01-27T14:32:45.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:32:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.324+0000 7f61d9a3d640 1 Processor -- start 2024-01-27T14:32:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.324+0000 7f61d9a3d640 1 -- start start 2024-01-27T14:32:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d9a3d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f61d415ce10 0x7f61d415d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d9a3d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d406c6e0 con 0x7f61d406baf0 2024-01-27T14:32:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d9a3d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d415d780 con 0x7f61d4153a90 2024-01-27T14:32:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d9a3d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d415da30 con 0x7f61d415ce10 2024-01-27T14:32:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f61d415ce10 0x7f61d415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.325+0000 7f61d37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f61d415ce10 0x7f61d415d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59954/0 (socket says 172.21.15.46:59954) 2024-01-27T14:32:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.326+0000 7f61d37fe640 1 -- 172.21.15.46:0/1810526796 learned_addr learned my addr 172.21.15.46:0/1810526796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.328+0000 7f61d27fc640 1 -- 172.21.15.46:0/1810526796 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049777278 0 0) 0x7f61d415d780 con 0x7f61d4153a90 2024-01-27T14:32:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.328+0000 7f61d27fc640 1 -- 172.21.15.46:0/1810526796 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003520 con 0x7f61d4153a90 2024-01-27T14:32:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.328+0000 7f61d37fe640 1 -- 172.21.15.46:0/1810526796 >> v1:172.21.15.73:6789/0 conn(0x7f61d4153a90 legacy=0x7f61d406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.328+0000 7f61d37fe640 1 -- 172.21.15.46:0/1810526796 >> v1:172.21.15.46:6789/0 conn(0x7f61d406baf0 legacy=0x7f61d40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.328+0000 7f61d37fe640 1 -- 172.21.15.46:0/1810526796 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d415dcf0 con 0x7f61d415ce10 2024-01-27T14:32:45.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.334+0000 7f61d37fe640 1 --2- 172.21.15.46:0/1810526796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d415ce10 0x7f61d415d240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009e50 tx=0x7f61cc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf0f7e52c82782e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.338+0000 7f61d27fc640 1 -- 172.21.15.46:0/1810526796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02cbb0 con 0x7f61d415ce10 2024-01-27T14:32:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.338+0000 7f61d27fc640 1 -- 172.21.15.46:0/1810526796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc02cd10 con 0x7f61d415ce10 2024-01-27T14:32:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.338+0000 7f61d27fc640 1 -- 172.21.15.46:0/1810526796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc034610 con 0x7f61d415ce10 2024-01-27T14:32:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.338+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1810526796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d415ce10 msgr2=0x7f61d415d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.338+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1810526796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d415ce10 0x7f61d415d240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009e50 tx=0x7f61cc02c010 comp rx=0 tx=0).stop 2024-01-27T14:32:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.339+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1810526796 shutdown_connections 2024-01-27T14:32:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.339+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1810526796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d415ce10 0x7f61d415d240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.339+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1810526796 >> 172.21.15.46:0/1810526796 conn(0x7f61d4070e40 msgr2=0x7f61d4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.339+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1810526796 shutdown_connections 2024-01-27T14:32:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.339+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1810526796 wait complete. 2024-01-27T14:32:45.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.340+0000 7f61d9a3d640 1 Processor -- start 2024-01-27T14:32:45.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.340+0000 7f61d9a3d640 1 -- start start 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d406baf0 0x7f61d4147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61d415ce10 0x7f61d41f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41f0000 con 0x7f61d4153a90 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41552a0 con 0x7f61d406baf0 2024-01-27T14:32:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61d9a3d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41efcf0 con 0x7f61d415ce10 2024-01-27T14:32:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.341+0000 7f61ca7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.342+0000 7f61ca7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59966/0 (socket says 172.21.15.46:59966) 2024-01-27T14:32:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.342+0000 7f61ca7fc640 1 -- 172.21.15.46:0/1648204940 learned_addr learned my addr 172.21.15.46:0/1648204940 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.342+0000 7f61d2ffd640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d406baf0 0x7f61d4147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.342+0000 7f61d37fe640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61d415ce10 0x7f61d41f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.345+0000 7f61ca7fc640 1 -- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61d415ce10 msgr2=0x7f61d41f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.345+0000 7f61ca7fc640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61d415ce10 0x7f61d41f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.345+0000 7f61ca7fc640 1 -- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d406baf0 msgr2=0x7f61d4147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.345+0000 7f61ca7fc640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d406baf0 0x7f61d4147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.345+0000 7f61ca7fc640 1 -- 172.21.15.46:0/1648204940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009b30 con 0x7f61d4153a90 2024-01-27T14:32:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.348+0000 7f61ca7fc640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c430 tx=0x7f61bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.351+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0052d0 con 0x7f61d4153a90 2024-01-27T14:32:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.351+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc005450 con 0x7f61d4153a90 2024-01-27T14:32:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.351+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4156fe0 con 0x7f61d4153a90 2024-01-27T14:32:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.351+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc007260 con 0x7f61d4153a90 2024-01-27T14:32:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.352+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d41482f0 con 0x7f61d4153a90 2024-01-27T14:32:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.352+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d41f01b0 con 0x7f61d4153a90 2024-01-27T14:32:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.373+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f61bc0073c0 con 0x7f61d4153a90 2024-01-27T14:32:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.373+0000 7f61d0ff9640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 0x7f61b406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.373+0000 7f61d2ffd640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 0x7f61b406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.374+0000 7f61d2ffd640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 0x7f61b406d3e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61c40011e0 tx=0x7f61c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:45.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.634+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f61bc057b40 con 0x7f61d4153a90 2024-01-27T14:32:45.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.634+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f61bc053e80 con 0x7f61d4153a90 2024-01-27T14:32:45.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.862+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61d4153e70 con 0x7f61d4153a90 2024-01-27T14:32:45.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.875+0000 7f61d0ff9640 1 -- 172.21.15.46:0/1648204940 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6578 (secure 0 0 0) 0x7f61bc0574a0 con 0x7f61d4153a90 2024-01-27T14:32:45.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:32:45.872 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:33.202914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253,"mds_3":4250,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:32:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.877+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 msgr2=0x7f61b406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.877+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 0x7f61b406d3e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61c40011e0 tx=0x7f61c4009040 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.877+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 msgr2=0x7f61d40c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.877+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c430 tx=0x7f61bc00c8f0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.877+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 shutdown_connections 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61b406af20 0x7f61b406d3e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f61d415ce10 0x7f61d41f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61d4153a90 0x7f61d40c31d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 --2- 172.21.15.46:0/1648204940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d406baf0 0x7f61d4147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 >> 172.21.15.46:0/1648204940 conn(0x7f61d4070e40 msgr2=0x7f61d4149670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 shutdown_connections 2024-01-27T14:32:45.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:45.878+0000 7f61d9a3d640 1 -- 172.21.15.46:0/1648204940 wait complete. 2024-01-27T14:32:46.489 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-27T14:31:51.484410+0000', 'modified': '2024-01-27T14:32:33.202914+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4267, 'mds_1': 4261, 'mds_2': 4253, 'mds_3': 4250, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'd', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.73:6833/1396170677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1396170677}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1396170677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4250': {'gid': 4250, 'name': 'a', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.46:6838/1704137428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6837', 'nonce': 1704137428}, {'type': 'v1', 'addr': '172.21.15.46:6838', 'nonce': 1704137428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4253': {'gid': 4253, 'name': 'c', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.46:6839/1910346878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 1910346878}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1910346878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4261': {'gid': 4261, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.73:6835/718826535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 718826535}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 718826535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4267': {'gid': 4267, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6837/2525471575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 2525471575}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2525471575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-27T14:32:46.490 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-27T14:32:46.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-27T14:32:46.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.596+0000 7f504bf05640 1 Processor -- start 2024-01-27T14:32:46.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.596+0000 7f504bf05640 1 -- start start 2024-01-27T14:32:46.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504bf05640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50440714d0 0x7f504415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504bf05640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50440c93b0 0x7f504415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504bf05640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50440c7ba0 con 0x7f50440710f0 2024-01-27T14:32:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504bf05640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044159a60 con 0x7f50440c93b0 2024-01-27T14:32:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504bf05640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044159d40 con 0x7f50440714d0 2024-01-27T14:32:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f504a4a2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50440c93b0 0x7f504415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.597+0000 7f50494a0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50440714d0 0x7f504415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.598+0000 7f50494a0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50440714d0 0x7f504415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40556/0 (socket says 172.21.15.46:40556) 2024-01-27T14:32:46.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.598+0000 7f50494a0640 1 -- 172.21.15.46:0/884058137 learned_addr learned my addr 172.21.15.46:0/884058137 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.600+0000 7f50494a0640 1 -- 172.21.15.46:0/884058137 >> v2:172.21.15.46:3300/0 conn(0x7f50440c93b0 msgr2=0x7f504415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.600+0000 7f50494a0640 1 --2- 172.21.15.46:0/884058137 >> v2:172.21.15.46:3300/0 conn(0x7f50440c93b0 0x7f504415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.600+0000 7f50494a0640 1 -- 172.21.15.46:0/884058137 >> v1:172.21.15.46:6789/0 conn(0x7f50440710f0 legacy=0x7f50440ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.600+0000 7f50494a0640 1 -- 172.21.15.46:0/884058137 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415a020 con 0x7f50440714d0 2024-01-27T14:32:46.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.602+0000 7f50494a0640 1 --2- 172.21.15.46:0/884058137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f504415d2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f504406ff70 tx=0x7f503402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ba085cce11d220 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.606+0000 7f5048c9f640 1 -- 172.21.15.46:0/884058137 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034030860 con 0x7f50440714d0 2024-01-27T14:32:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.606+0000 7f5048c9f640 1 -- 172.21.15.46:0/884058137 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340309c0 con 0x7f50440714d0 2024-01-27T14:32:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.606+0000 7f5048c9f640 1 -- 172.21.15.46:0/884058137 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034030d50 con 0x7f50440714d0 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 -- 172.21.15.46:0/884058137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 msgr2=0x7f504415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 --2- 172.21.15.46:0/884058137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f504415d2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f504406ff70 tx=0x7f503402b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 -- 172.21.15.46:0/884058137 shutdown_connections 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 --2- 172.21.15.46:0/884058137 >> v2:172.21.15.46:3300/0 conn(0x7f50440c93b0 0x7f504415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 --2- 172.21.15.46:0/884058137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f504415d2c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 -- 172.21.15.46:0/884058137 >> 172.21.15.46:0/884058137 conn(0x7f5044066ac0 msgr2=0x7f504406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 -- 172.21.15.46:0/884058137 shutdown_connections 2024-01-27T14:32:46.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.607+0000 7f504bf05640 1 -- 172.21.15.46:0/884058137 wait complete. 2024-01-27T14:32:46.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.608+0000 7f504bf05640 1 Processor -- start 2024-01-27T14:32:46.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.608+0000 7f504bf05640 1 -- start start 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50440710f0 0x7f50440cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f5044148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 0x7f5044148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415cb80 con 0x7f50440c93b0 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415c650 con 0x7f50440714d0 2024-01-27T14:32:46.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504bf05640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50440cdb80 con 0x7f50440710f0 2024-01-27T14:32:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.609+0000 7f504a4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 0x7f5044148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.610+0000 7f50494a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f5044148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.610+0000 7f5049ca1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50440710f0 0x7f50440cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.610+0000 7f504a4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 0x7f5044148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59992/0 (socket says 172.21.15.46:59992) 2024-01-27T14:32:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.610+0000 7f504a4a2640 1 -- 172.21.15.46:0/1961498449 learned_addr learned my addr 172.21.15.46:0/1961498449 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.613+0000 7f50494a0640 1 -- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50440710f0 msgr2=0x7f50440cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.613+0000 7f50494a0640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50440710f0 0x7f50440cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.613+0000 7f50494a0640 1 -- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 msgr2=0x7f5044148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.613+0000 7f50494a0640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 0x7f5044148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.613+0000 7f50494a0640 1 -- 172.21.15.46:0/1961498449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340094d0 con 0x7f50440714d0 2024-01-27T14:32:46.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.616+0000 7f50494a0640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f5044148920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5034033000 tx=0x7f5034004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.618+0000 7f503a7fc640 1 -- 172.21.15.46:0/1961498449 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034039c90 con 0x7f50440714d0 2024-01-27T14:32:46.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.618+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504415c8a0 con 0x7f50440714d0 2024-01-27T14:32:46.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.618+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50440cad10 con 0x7f50440714d0 2024-01-27T14:32:46.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.619+0000 7f503a7fc640 1 -- 172.21.15.46:0/1961498449 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034039df0 con 0x7f50440714d0 2024-01-27T14:32:46.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.619+0000 7f503a7fc640 1 -- 172.21.15.46:0/1961498449 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503404d660 con 0x7f50440714d0 2024-01-27T14:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.621+0000 7f504eb9e740 1 Processor -- start 2024-01-27T14:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.621+0000 7f504eb9e740 1 -- start start 2024-01-27T14:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b44a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b85090 0x555b80b83f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80ab2030 con 0x555b80b43750 2024-01-27T14:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80aaf720 con 0x555b80b85090 2024-01-27T14:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b80aab010 con 0x555b80b84cb0 2024-01-27T14:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f5049ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.622+0000 7f504a4a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b44a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.623+0000 7f5049ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59994/0 (socket says 172.21.15.46:59994) 2024-01-27T14:32:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.623+0000 7f5049ca1640 1 -- 172.21.15.46:0/1080813669 learned_addr learned my addr 172.21.15.46:0/1080813669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.625+0000 7f5049ca1640 1 -- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 msgr2=0x555b80b44a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.625+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b44a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.625+0000 7f5049ca1640 1 -- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b85090 msgr2=0x555b80b83f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.625+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b85090 0x555b80b83f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.625+0000 7f5049ca1640 1 -- 172.21.15.46:0/1080813669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b80a6d680 con 0x555b80b43750 2024-01-27T14:32:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.627+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5040001660 tx=0x7f5040007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bfd7e828f2da52 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.630+0000 7f502f7fe640 1 -- 172.21.15.46:0/1080813669 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040001310 con 0x555b80b43750 2024-01-27T14:32:46.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f502f7fe640 1 -- 172.21.15.46:0/1080813669 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040001d00 con 0x555b80b43750 2024-01-27T14:32:46.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f502f7fe640 1 -- 172.21.15.46:0/1080813669 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000f7b0 con 0x555b80b43750 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 -- 172.21.15.46:0/1080813669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 msgr2=0x555b80b85670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5040001660 tx=0x7f5040007e50 comp rx=0 tx=0).stop 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 -- 172.21.15.46:0/1080813669 shutdown_connections 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b85090 0x555b80b83f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b43750 0x555b80b85670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1080813669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b44a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 -- 172.21.15.46:0/1080813669 >> 172.21.15.46:0/1080813669 conn(0x555b80b408c0 msgr2=0x555b80b44060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 -- 172.21.15.46:0/1080813669 shutdown_connections 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.631+0000 7f504eb9e740 1 -- 172.21.15.46:0/1080813669 wait complete. 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.632+0000 7f504eb9e740 1 -- start start 2024-01-27T14:32:46.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.632+0000 7f504eb9e740 1 Processor -- start 2024-01-27T14:32:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b62e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b98300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80a645f0 con 0x555b80b88a60 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80a64290 con 0x555b80b84cb0 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b80a29300 con 0x555b80b85090 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f504eb9e740 10 client.0 _ll_register_callbacks cb 0x555b80a5f260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.633+0000 7f50494a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.634+0000 7f50494a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60000/0 (socket says 172.21.15.46:60000) 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.634+0000 7f50494a0640 1 -- 172.21.15.46:0/1808043101 learned_addr learned my addr 172.21.15.46:0/1808043101 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.634+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b98300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.637+0000 7f50494a0640 1 -- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 msgr2=0x555b80b98300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.637+0000 7f50494a0640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b98300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.637+0000 7f50494a0640 1 -- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 msgr2=0x555b80b62e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.637+0000 7f50494a0640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b62e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.637+0000 7f50494a0640 1 -- 172.21.15.46:0/1808043101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50440c7ba0 con 0x555b80b88a60 2024-01-27T14:32:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.640+0000 7f503a7fc640 1 -- 172.21.15.46:0/1961498449 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5034043d10 con 0x7f50440714d0 2024-01-27T14:32:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.640+0000 7f50494a0640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5034045040 tx=0x7f50340437d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72016b8bae733602 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.640+0000 7f502cff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T14:32:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.641+0000 7f503a7fc640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 0x7f502806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.641+0000 7f504a4a2640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 0x7f502806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.641+0000 7f504a4a2640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 0x7f502806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5044156780 tx=0x7f503c009750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.645+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b3030 con 0x555b80b88a60 2024-01-27T14:32:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.645+0000 7f503a7fc640 1 -- 172.21.15.46:0/1961498449 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f503403e070 con 0x7f50440714d0 2024-01-27T14:32:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.645+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f50340b4070 con 0x555b80b88a60 2024-01-27T14:32:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.645+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b80aa3ea0 con 0x555b80b88a60 2024-01-27T14:32:46.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.648+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503407d230 con 0x555b80b88a60 2024-01-27T14:32:46.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.648+0000 7f504eb9e740 10 client.4680 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:46.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.648+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555b80aa9690 con 0x555b80b88a60 2024-01-27T14:32:46.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b80aa3ea0 con 0x555b80b88a60 2024-01-27T14:32:46.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f5034079b70 con 0x555b80b88a60 2024-01-27T14:32:46.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 10 client.4680 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:46.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-27T14:32:46.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 20 client.4680 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:46.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b65ea0 0x555b80b66280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 4 client.4680 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:46.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.652+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 --> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b80aa3bc0 con 0x555b80b65ea0 2024-01-27T14:32:46.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.662+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b65ea0 0x555b80b66280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.748+0000 7f5049ca1640 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b65ea0 0x555b80b66280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=580ef027993702d7 server_cookie=aec568918996b75 in_seq=0 out_seq=0 2024-01-27T14:32:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.748+0000 7f502cff9640 10 client.4680 ms_handle_connect on v2:172.21.15.73:6832/1396170677 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f502cff9640 1 -- 172.21.15.46:0/1808043101 <== mds.4 v2:172.21.15.73:6832/1396170677 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555b80aa3bc0 con 0x555b80b65ea0 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f502cff9640 10 client.4680 handle_command_reply: tid=0 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 client.4680 shutdown 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 msgr2=0x555b80b64aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5034045040 tx=0x7f50340437d0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 shutdown_connections 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b65ea0 0x555b80b66280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b88a60 0x555b80b64aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f502cff9640 0 client.4680 ms_handle_reset on v2:172.21.15.73:6832/1396170677 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b98300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 --2- 172.21.15.46:0/1808043101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b62e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 >> 172.21.15.46:0/1808043101 conn(0x555b80b43750 msgr2=0x555b80b447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 shutdown_connections 2024-01-27T14:32:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 1 -- 172.21.15.46:0/1808043101 wait complete. 2024-01-27T14:32:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.858+0000 7f504eb9e740 20 client.4680 trim_cache size 0 max 16384 2024-01-27T14:32:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.874+0000 7f504eb9e740 1 Processor -- start 2024-01-27T14:32:46.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.874+0000 7f504eb9e740 1 -- start start 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b85090 0x555b80b6b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80b3f770 con 0x555b80b85090 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80b6a970 con 0x555b80b65ea0 2024-01-27T14:32:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b80b3fdf0 con 0x555b80b84cb0 2024-01-27T14:32:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.875+0000 7f504a4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b85090 0x555b80b6b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.876+0000 7f5049ca1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.876+0000 7f50494a0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.876+0000 7f5049ca1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40590/0 (socket says 172.21.15.46:40590) 2024-01-27T14:32:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.876+0000 7f5049ca1640 1 -- 172.21.15.46:0/681952298 learned_addr learned my addr 172.21.15.46:0/681952298 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.878+0000 7f5049ca1640 1 -- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 msgr2=0x555b80b6ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.878+0000 7f5049ca1640 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b6ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.878+0000 7f5049ca1640 1 -- 172.21.15.46:0/681952298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b85090 msgr2=0x555b80b6b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.878+0000 7f5049ca1640 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b85090 0x555b80b6b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.878+0000 7f5049ca1640 1 -- 172.21.15.46:0/681952298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b80a46390 con 0x555b80b65ea0 2024-01-27T14:32:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.880+0000 7f5049ca1640 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5040009010 tx=0x7f504000a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=426ff328fdcb8f99 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.884+0000 7f502effd640 1 -- 172.21.15.46:0/681952298 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040022070 con 0x555b80b65ea0 2024-01-27T14:32:46.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.884+0000 7f502effd640 1 -- 172.21.15.46:0/681952298 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040023040 con 0x555b80b65ea0 2024-01-27T14:32:46.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.884+0000 7f502effd640 1 -- 172.21.15.46:0/681952298 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040026a90 con 0x555b80b65ea0 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 msgr2=0x555b80b82050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5040009010 tx=0x7f504000a000 comp rx=0 tx=0).stop 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- 172.21.15.46:0/681952298 shutdown_connections 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b85090 0x555b80b6b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b84cb0 0x555b80b6ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 --2- 172.21.15.46:0/681952298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b65ea0 0x555b80b82050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- 172.21.15.46:0/681952298 >> 172.21.15.46:0/681952298 conn(0x555b80b43750 msgr2=0x555b80b6d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- 172.21.15.46:0/681952298 shutdown_connections 2024-01-27T14:32:46.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- 172.21.15.46:0/681952298 wait complete. 2024-01-27T14:32:46.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 -- start start 2024-01-27T14:32:46.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.885+0000 7f504eb9e740 1 Processor -- start 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b65ea0 0x555b80be9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b68290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80b63b30 con 0x555b80b65ea0 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b80b64570 con 0x555b80b84cb0 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b80ba7f90 con 0x555b80b85090 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.886+0000 7f504eb9e740 10 client.0 _ll_register_callbacks cb 0x7f5040001240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.887+0000 7f504a4a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b68290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.887+0000 7f50494a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.887+0000 7f50494a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40592/0 (socket says 172.21.15.46:40592) 2024-01-27T14:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.887+0000 7f50494a0640 1 -- 172.21.15.46:0/2270824888 learned_addr learned my addr 172.21.15.46:0/2270824888 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:46.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.888+0000 7f5049ca1640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b65ea0 0x555b80be9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f50494a0640 1 -- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 msgr2=0x555b80b68290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f50494a0640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b68290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f50494a0640 1 -- 172.21.15.46:0/2270824888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b65ea0 msgr2=0x555b80be9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f50494a0640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b65ea0 0x555b80be9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f50494a0640 1 -- 172.21.15.46:0/2270824888 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b80a6d680 con 0x555b80b84cb0 2024-01-27T14:32:46.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.890+0000 7f504a4a2640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.892+0000 7f50494a0640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f503407d3f0 tx=0x7f50340accd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a0d79f3cd762ea server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.892+0000 7f502cff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-01-27T14:32:46.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.895+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b3040 con 0x555b80b84cb0 2024-01-27T14:32:46.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.895+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5040001d00 con 0x555b80b84cb0 2024-01-27T14:32:46.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.897+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5034085760 con 0x555b80b84cb0 2024-01-27T14:32:46.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.898+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503407d230 con 0x555b80b84cb0 2024-01-27T14:32:46.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.898+0000 7f504eb9e740 10 client.4720 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:46.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.898+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555b80a6bee0 con 0x555b80b84cb0 2024-01-27T14:32:46.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040001d00 con 0x555b80b84cb0 2024-01-27T14:32:46.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f503404da50 con 0x555b80b84cb0 2024-01-27T14:32:46.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 10 client.4720 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 10 client.4720 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 20 client.4720 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b88a60 0x555b80b96d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 4 client.4720 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.902+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 --> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555b807aa6c0 con 0x555b80b88a60 2024-01-27T14:32:46.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.903+0000 7f5049ca1640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b88a60 0x555b80b96d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:46.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.906+0000 7f5049ca1640 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b88a60 0x555b80b96d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b216a3921041c211 server_cookie=1052a187008b5a2 in_seq=0 out_seq=0 2024-01-27T14:32:46.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.906+0000 7f502cff9640 10 client.4720 ms_handle_connect on v2:172.21.15.73:6832/1396170677 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f502cff9640 1 -- 172.21.15.46:0/2270824888 <== mds.4 v2:172.21.15.73:6832/1396170677 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555b807aa6c0 con 0x555b80b88a60 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f502cff9640 10 client.4720 handle_command_reply: tid=0 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 client.4720 shutdown 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 msgr2=0x555b80b3df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f503407d3f0 tx=0x7f50340accd0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 shutdown_connections 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:6832/1396170677,v1:172.21.15.73:6833/1396170677] conn(0x555b80b88a60 0x555b80b96d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555b80b84cb0 0x555b80b3df20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555b80b85090 0x555b80b68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 --2- 172.21.15.46:0/2270824888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555b80b65ea0 0x555b80be9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f502cff9640 0 client.4720 ms_handle_reset on v2:172.21.15.73:6832/1396170677 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 >> 172.21.15.46:0/2270824888 conn(0x555b80b43750 msgr2=0x555b80b69fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 shutdown_connections 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 1 -- 172.21.15.46:0/2270824888 wait complete. 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504eb9e740 20 client.4720 trim_cache size 0 max 16384 2024-01-27T14:32:46.922 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4241, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 14.901861722, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 29, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 29, 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 64.225560986999994 2024-01-27T14:32:46.923 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:46.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 msgr2=0x7f502806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 0x7f502806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5044156780 tx=0x7f503c009750 comp rx=0 tx=0).stop 2024-01-27T14:32:46.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 msgr2=0x7f5044148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:46.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f5044148920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5034033000 tx=0x7f5034004730 comp rx=0 tx=0).stop 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 shutdown_connections 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f502806ae70 0x7f502806d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50440714d0 0x7f5044148920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50440c93b0 0x7f5044148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 --2- 172.21.15.46:0/1961498449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50440710f0 0x7f50440cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.924+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 >> 172.21.15.46:0/1961498449 conn(0x7f5044066ac0 msgr2=0x7f50440c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.925+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 shutdown_connections 2024-01-27T14:32:46.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:46.925+0000 7f504bf05640 1 -- 172.21.15.46:0/1961498449 wait complete. 2024-01-27T14:32:46.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-27T14:32:47.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.048+0000 7f1abeb61640 1 Processor -- start 2024-01-27T14:32:47.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.048+0000 7f1abeb61640 1 -- start start 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.049+0000 7f1abeb61640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80ca340 0x7f1ab8070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.049+0000 7f1abeb61640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab8071270 0x7f1ab815d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.049+0000 7f1abeb61640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab815cd50 con 0x7f1ab8153930 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.049+0000 7f1abeb61640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab806d3f0 con 0x7f1ab80ca340 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.049+0000 7f1abeb61640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c9580 con 0x7f1ab8071270 2024-01-27T14:32:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.050+0000 7f1ab7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80ca340 0x7f1ab8070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.050+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab8071270 0x7f1ab815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.050+0000 7f1ab7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80ca340 0x7f1ab8070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40600/0 (socket says 172.21.15.46:40600) 2024-01-27T14:32:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.050+0000 7f1ab7fff640 1 -- 172.21.15.46:0/906860039 learned_addr learned my addr 172.21.15.46:0/906860039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.053+0000 7f1ab7fff640 1 -- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab8071270 msgr2=0x7f1ab815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.053+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab8071270 0x7f1ab815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.053+0000 7f1ab7fff640 1 -- 172.21.15.46:0/906860039 >> v1:172.21.15.46:6789/0 conn(0x7f1ab8153930 legacy=0x7f1ab80c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.053+0000 7f1ab7fff640 1 -- 172.21.15.46:0/906860039 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8159a30 con 0x7f1ab80ca340 2024-01-27T14:32:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.056+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80ca340 0x7f1ab8070d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a060290490cbda7f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.059+0000 7f1ab77fe640 1 -- 172.21.15.46:0/906860039 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4030840 con 0x7f1ab80ca340 2024-01-27T14:32:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.059+0000 7f1ab77fe640 1 -- 172.21.15.46:0/906860039 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40309a0 con 0x7f1ab80ca340 2024-01-27T14:32:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.059+0000 7f1ab77fe640 1 -- 172.21.15.46:0/906860039 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4030d30 con 0x7f1ab80ca340 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 -- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80ca340 msgr2=0x7f1ab8070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 --2- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80ca340 0x7f1ab8070d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa402b980 comp rx=0 tx=0).stop 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 -- 172.21.15.46:0/906860039 shutdown_connections 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 --2- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab8071270 0x7f1ab815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 --2- 172.21.15.46:0/906860039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80ca340 0x7f1ab8070d30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 -- 172.21.15.46:0/906860039 >> 172.21.15.46:0/906860039 conn(0x7f1ab8066c80 msgr2=0x7f1ab806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 -- 172.21.15.46:0/906860039 shutdown_connections 2024-01-27T14:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.060+0000 7f1abeb61640 1 -- 172.21.15.46:0/906860039 wait complete. 2024-01-27T14:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.061+0000 7f1abeb61640 1 Processor -- start 2024-01-27T14:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.061+0000 7f1abeb61640 1 -- start start 2024-01-27T14:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab80ca340 0x7f1ab81ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab8153930 0x7f1ab8147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c32e0 con 0x7f1ab8071270 2024-01-27T14:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ef970 con 0x7f1ab8153930 2024-01-27T14:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abeb61640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81e3250 con 0x7f1ab80ca340 2024-01-27T14:32:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abc8fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab80ca340 0x7f1ab81ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.062+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab8153930 0x7f1ab8147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.063+0000 7f1abc8fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60034/0 (socket says 172.21.15.46:60034) 2024-01-27T14:32:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.063+0000 7f1abc8fd640 1 -- 172.21.15.46:0/718279827 learned_addr learned my addr 172.21.15.46:0/718279827 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.066+0000 7f1abc8fd640 1 -- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab80ca340 msgr2=0x7f1ab81ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.066+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab80ca340 0x7f1ab81ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.066+0000 7f1abc8fd640 1 -- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab8153930 msgr2=0x7f1ab8147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.066+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab8153930 0x7f1ab8147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.066+0000 7f1abc8fd640 1 -- 172.21.15.46:0/718279827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40094d0 con 0x7f1ab8071270 2024-01-27T14:32:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.069+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c410 tx=0x7f1aac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.073+0000 7f1ab57fa640 1 -- 172.21.15.46:0/718279827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0035f0 con 0x7f1ab8071270 2024-01-27T14:32:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.073+0000 7f1ab57fa640 1 -- 172.21.15.46:0/718279827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac003750 con 0x7f1ab8071270 2024-01-27T14:32:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.073+0000 7f1ab57fa640 1 -- 172.21.15.46:0/718279827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac003b40 con 0x7f1ab8071270 2024-01-27T14:32:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.073+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab81f2ad0 con 0x7f1ab8071270 2024-01-27T14:32:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.073+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab81e2f70 con 0x7f1ab8071270 2024-01-27T14:32:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.075+0000 7f1ac17fe740 1 Processor -- start 2024-01-27T14:32:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.075+0000 7f1ac17fe740 1 -- start start 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a522a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a521750 0x56427a563670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a490030 con 0x56427a521750 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a48d720 con 0x56427a563090 2024-01-27T14:32:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.076+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56427a489010 con 0x56427a562cb0 2024-01-27T14:32:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.077+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a522a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.077+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.077+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40624/0 (socket says 172.21.15.46:40624) 2024-01-27T14:32:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.077+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2066571207 learned_addr learned my addr 172.21.15.46:0/2066571207 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.080+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 msgr2=0x56427a522a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.080+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a522a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.080+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2066571207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a521750 msgr2=0x56427a563670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.080+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a521750 0x56427a563670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.080+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2066571207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56427a44b680 con 0x56427a563090 2024-01-27T14:32:47.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.082+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa4030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7631887603279597 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1aa27fc640 1 -- 172.21.15.46:0/2066571207 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4030d10 con 0x56427a563090 2024-01-27T14:32:47.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1aa27fc640 1 -- 172.21.15.46:0/2066571207 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4030e70 con 0x56427a563090 2024-01-27T14:32:47.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1aa27fc640 1 -- 172.21.15.46:0/2066571207 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4039650 con 0x56427a563090 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 msgr2=0x56427a561f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa4030000 comp rx=0 tx=0).stop 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2066571207 shutdown_connections 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a561f90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a521750 0x56427a563670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2066571207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a522a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.086+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2066571207 >> 172.21.15.46:0/2066571207 conn(0x56427a51e8c0 msgr2=0x56427a522060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.087+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2066571207 shutdown_connections 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.087+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2066571207 wait complete. 2024-01-27T14:32:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.087+0000 7f1ac17fe740 1 -- start start 2024-01-27T14:32:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.087+0000 7f1ac17fe740 1 Processor -- start 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a5499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a563090 0x56427a54ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a4425f0 con 0x56427a563090 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a442290 con 0x56427a562cb0 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56427a407300 con 0x56427a573930 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.088+0000 7f1ac17fe740 10 client.0 _ll_register_callbacks cb 0x56427a43d260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.089+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.089+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a5499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.089+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55712/0 (socket says 172.21.15.46:55712) 2024-01-27T14:32:47.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.089+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2417506526 learned_addr learned my addr 172.21.15.46:0/2417506526 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab57fa640 1 -- 172.21.15.46:0/718279827 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1aac003ca0 con 0x7f1ab8071270 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab57fa640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 0x7f1a9c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1abd0fe640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 0x7f1a9c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 msgr2=0x56427a5499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a5499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a563090 msgr2=0x56427a54ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a563090 0x56427a54ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.093+0000 7f1ab7fff640 1 -- 172.21.15.46:0/2417506526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab8159a30 con 0x56427a573930 2024-01-27T14:32:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.094+0000 7f1abd0fe640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 0x7f1a9c06d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0018c20 tx=0x7f1ab0004a40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.096+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4046040 tx=0x7f1aa4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9d65526e5a4c7e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.096+0000 7f1a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-01-27T14:32:47.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.098+0000 7f1ab57fa640 1 -- 172.21.15.46:0/718279827 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1aac059a10 con 0x7f1ab8071270 2024-01-27T14:32:47.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.100+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4003810 con 0x56427a573930 2024-01-27T14:32:47.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.100+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1aa403e040 con 0x56427a573930 2024-01-27T14:32:47.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.100+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56427a481ea0 con 0x56427a573930 2024-01-27T14:32:47.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.104+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa4003970 con 0x56427a573930 2024-01-27T14:32:47.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.104+0000 7f1ac17fe740 10 client.4652 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:47.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.104+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x56427a487690 con 0x56427a573930 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.117+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56427a481ea0 con 0x56427a573930 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1aa4003ad0 con 0x56427a573930 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 10 client.4652 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 10 client.4652 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 20 client.4652 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a56ca90 0x56427a56ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 4 client.4652 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 --> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56427a481bc0 con 0x56427a56ca90 2024-01-27T14:32:47.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.118+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a56ca90 0x56427a56ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.158+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a56ca90 0x56427a56ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d353cc98f810b22 server_cookie=3726a270b64e976 in_seq=0 out_seq=0 2024-01-27T14:32:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.158+0000 7f1a977fe640 10 client.4652 ms_handle_connect on v2:172.21.15.46:6837/1704137428 2024-01-27T14:32:47.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.269+0000 7f1a977fe640 1 -- 172.21.15.46:0/2417506526 <== mds.3 v2:172.21.15.46:6837/1704137428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56427a481bc0 con 0x56427a56ca90 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.269+0000 7f1a977fe640 10 client.4652 handle_command_reply: tid=0 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 client.4652 shutdown 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 msgr2=0x56427a5666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4046040 tx=0x7f1aa4004730 comp rx=0 tx=0).stop 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 shutdown_connections 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a56ca90 0x56427a56ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a573930 0x56427a5666a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a563090 0x56427a54ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1a977fe640 0 client.4652 ms_handle_reset on v2:172.21.15.46:6837/1704137428 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/2417506526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a5499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 >> 172.21.15.46:0/2417506526 conn(0x56427a521750 msgr2=0x56427a51f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 shutdown_connections 2024-01-27T14:32:47.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 1 -- 172.21.15.46:0/2417506526 wait complete. 2024-01-27T14:32:47.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.270+0000 7f1ac17fe740 20 client.4652 trim_cache size 0 max 16384 2024-01-27T14:32:47.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 Processor -- start 2024-01-27T14:32:47.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 -- start start 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a585aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a51f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a51fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a57d330 con 0x56427a573930 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a576240 con 0x56427a563090 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.286+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56427a54a330 con 0x56427a562cb0 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.287+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a51fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.287+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a51f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.287+0000 7f1abd0fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a51fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2024-01-27T14:32:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.287+0000 7f1abd0fe640 1 -- 172.21.15.46:0/4098152484 learned_addr learned my addr 172.21.15.46:0/4098152484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.289+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a585aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.290+0000 7f1ab7fff640 1 -- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 msgr2=0x56427a585aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.290+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a585aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.290+0000 7f1ab7fff640 1 -- 172.21.15.46:0/4098152484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 msgr2=0x56427a51fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.290+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a51fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.290+0000 7f1ab7fff640 1 -- 172.21.15.46:0/4098152484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56427a520a70 con 0x56427a563090 2024-01-27T14:32:47.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.291+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a51f790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa404d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4330d010e695e1c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.295+0000 7f1aa1ffb640 1 -- 172.21.15.46:0/4098152484 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40041e0 con 0x56427a563090 2024-01-27T14:32:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.295+0000 7f1aa1ffb640 1 -- 172.21.15.46:0/4098152484 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa402c080 con 0x56427a563090 2024-01-27T14:32:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.295+0000 7f1aa1ffb640 1 -- 172.21.15.46:0/4098152484 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4003850 con 0x56427a563090 2024-01-27T14:32:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 -- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 msgr2=0x56427a51f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a51f790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa404d000 comp rx=0 tx=0).stop 2024-01-27T14:32:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 -- 172.21.15.46:0/4098152484 shutdown_connections 2024-01-27T14:32:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a563090 0x56427a51f790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a51fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/4098152484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a562cb0 0x56427a585aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 -- 172.21.15.46:0/4098152484 >> 172.21.15.46:0/4098152484 conn(0x56427a521750 msgr2=0x56427a54b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 -- 172.21.15.46:0/4098152484 shutdown_connections 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.296+0000 7f1ac17fe740 1 -- 172.21.15.46:0/4098152484 wait complete. 2024-01-27T14:32:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.297+0000 7f1ac17fe740 1 -- start start 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.297+0000 7f1ac17fe740 1 Processor -- start 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a540450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 0x56427a543650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a543b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a566740 con 0x56427a573930 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427a540990 con 0x56427a562cb0 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56427a561cf0 con 0x56427a563090 2024-01-27T14:32:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ac17fe740 10 client.0 _ll_register_callbacks cb 0x7f1aa40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1abc8fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a540450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.298+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 0x56427a543650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.299+0000 7f1abc8fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a540450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40650/0 (socket says 172.21.15.46:40650) 2024-01-27T14:32:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.299+0000 7f1abc8fd640 1 -- 172.21.15.46:0/1740277344 learned_addr learned my addr 172.21.15.46:0/1740277344 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.300+0000 7f1abd0fe640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a543b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.302+0000 7f1ab7fff640 1 -- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 msgr2=0x56427a540450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.302+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a540450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.302+0000 7f1ab7fff640 1 -- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 msgr2=0x56427a543b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.302+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a543b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.302+0000 7f1ab7fff640 1 -- 172.21.15.46:0/1740277344 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56427a487690 con 0x56427a563090 2024-01-27T14:32:47.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.304+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 0x56427a543650 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4004770 tx=0x7f1aa4040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847796157c60b623 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.304+0000 7f1a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-01-27T14:32:47.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.307+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4030640 con 0x56427a563090 2024-01-27T14:32:47.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.307+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1aa403e040 con 0x56427a563090 2024-01-27T14:32:47.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.307+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56427a1886c0 con 0x56427a563090 2024-01-27T14:32:47.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.309+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa4056250 con 0x56427a563090 2024-01-27T14:32:47.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.309+0000 7f1ac17fe740 10 client.4658 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:47.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.309+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x56427a424390 con 0x56427a563090 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56427a1886c0 con 0x56427a563090 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1aa40563b0 con 0x56427a563090 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 10 client.4658 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 10 client.4658 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 20 client.4658 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a5440d0 0x56427a5c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 4 client.4658 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.313+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 --> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56427a1dbd10 con 0x56427a5440d0 2024-01-27T14:32:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.314+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a5440d0 0x56427a5c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.317+0000 7f1a977fe640 10 client.4658 ms_handle_connect on v2:172.21.15.46:6837/1704137428 2024-01-27T14:32:47.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.317+0000 7f1abc8fd640 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a5440d0 0x56427a5c7660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=607b20796536f92f server_cookie=8025c7505febdc1d in_seq=0 out_seq=0 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1a977fe640 1 -- 172.21.15.46:0/1740277344 <== mds.3 v2:172.21.15.46:6837/1704137428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56427a1dbd10 con 0x56427a5440d0 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1a977fe640 10 client.4658 handle_command_reply: tid=0 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 client.4658 shutdown 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 msgr2=0x56427a543650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 0x56427a543650 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4004770 tx=0x7f1aa4040000 comp rx=0 tx=0).stop 2024-01-27T14:32:47.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 shutdown_connections 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:6837/1704137428,v1:172.21.15.46:6838/1704137428] conn(0x56427a5440d0 0x56427a5c7660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56427a573930 0x56427a543b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56427a563090 0x56427a543650 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1a977fe640 0 client.4658 ms_handle_reset on v2:172.21.15.46:6837/1704137428 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 --2- 172.21.15.46:0/1740277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56427a562cb0 0x56427a540450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 >> 172.21.15.46:0/1740277344 conn(0x56427a521750 msgr2=0x56427a521ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 shutdown_connections 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.335+0000 7f1ac17fe740 1 -- 172.21.15.46:0/1740277344 wait complete. 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1ac17fe740 20 client.4658 trim_cache size 0 max 16384 2024-01-27T14:32:47.334 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4250, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 17.489825763999999, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 29, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 29, 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 64.382547832 2024-01-27T14:32:47.335 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:47.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 msgr2=0x7f1a9c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 0x7f1a9c06d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0018c20 tx=0x7f1ab0004a40 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 msgr2=0x7f1ab80c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c410 tx=0x7f1aac00c8d0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 shutdown_connections 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f1a9c06ae90 0x7f1a9c06d350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab8153930 0x7f1ab8147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ab80ca340 0x7f1ab81ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 --2- 172.21.15.46:0/718279827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8071270 0x7f1ab80c6d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.336+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 >> 172.21.15.46:0/718279827 conn(0x7f1ab8066c80 msgr2=0x7f1ab815d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.337+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 shutdown_connections 2024-01-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.337+0000 7f1abeb61640 1 -- 172.21.15.46:0/718279827 wait complete. 2024-01-27T14:32:47.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-27T14:32:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.450+0000 7f2cc0133640 1 Processor -- start 2024-01-27T14:32:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.450+0000 7f2cc0133640 1 -- start start 2024-01-27T14:32:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.450+0000 7f2cc0133640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 0x7f2cb80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.450+0000 7f2cc0133640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb80714d0 0x7f2cb815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.450+0000 7f2cc0133640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2cb80c93b0 0x7f2cb815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cc0133640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80ca870 con 0x7f2cb80c93b0 2024-01-27T14:32:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cc0133640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80c7ba0 con 0x7f2cb80714d0 2024-01-27T14:32:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cc0133640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8159a60 con 0x7f2cb80710f0 2024-01-27T14:32:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cbd6ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb80714d0 0x7f2cb815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 0x7f2cb80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cbd6ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb80714d0 0x7f2cb815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40662/0 (socket says 172.21.15.46:40662) 2024-01-27T14:32:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/1679994462 learned_addr learned my addr 172.21.15.46:0/1679994462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.451+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 0x7f2cb80ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55742/0 (socket says 172.21.15.46:55742) 2024-01-27T14:32:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.452+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/1679994462 >> v2:172.21.15.46:3300/0 conn(0x7f2cb80c93b0 0x7f2cb815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.454+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 msgr2=0x7f2cb80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.454+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 0x7f2cb80ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.454+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/1679994462 >> v2:172.21.15.46:3300/0 conn(0x7f2cb80c93b0 msgr2=0x7f2cb815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.454+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/1679994462 >> v2:172.21.15.46:3300/0 conn(0x7f2cb80c93b0 0x7f2cb815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.454+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/1679994462 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8159d40 con 0x7f2cb80714d0 2024-01-27T14:32:47.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.455+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80714d0 0x7f2cb815d2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2cb806fed0 tx=0x7f2ca802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae021d01617e567 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.459+0000 7f2cbcecd640 1 -- 172.21.15.46:0/1679994462 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030860 con 0x7f2cb80714d0 2024-01-27T14:32:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.459+0000 7f2cbcecd640 1 -- 172.21.15.46:0/1679994462 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80309c0 con 0x7f2cb80714d0 2024-01-27T14:32:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.459+0000 7f2cbcecd640 1 -- 172.21.15.46:0/1679994462 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030d50 con 0x7f2cb80714d0 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 -- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80714d0 msgr2=0x7f2cb815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80714d0 0x7f2cb815d2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2cb806fed0 tx=0x7f2ca802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 -- 172.21.15.46:0/1679994462 shutdown_connections 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 --2- 172.21.15.46:0/1679994462 >> v2:172.21.15.46:3300/0 conn(0x7f2cb80c93b0 0x7f2cb815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80714d0 0x7f2cb815d2c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 --2- 172.21.15.46:0/1679994462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80710f0 0x7f2cb80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 -- 172.21.15.46:0/1679994462 >> 172.21.15.46:0/1679994462 conn(0x7f2cb8066ac0 msgr2=0x7f2cb806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 -- 172.21.15.46:0/1679994462 shutdown_connections 2024-01-27T14:32:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.460+0000 7f2cc0133640 1 -- 172.21.15.46:0/1679994462 wait complete. 2024-01-27T14:32:47.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.461+0000 7f2cc0133640 1 Processor -- start 2024-01-27T14:32:47.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.461+0000 7f2cc0133640 1 -- start start 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 0x7f2cb8156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80714d0 0x7f2cb8150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 0x7f2cb81ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb815a8b0 con 0x7f2cb80c93b0 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81ef170 con 0x7f2cb80710f0 2024-01-27T14:32:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cc0133640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81f2b20 con 0x7f2cb80714d0 2024-01-27T14:32:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.462+0000 7f2cbe6d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 0x7f2cb81ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.463+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80714d0 0x7f2cb8150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.463+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 0x7f2cb8156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.463+0000 7f2cbe6d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 0x7f2cb81ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60088/0 (socket says 172.21.15.46:60088) 2024-01-27T14:32:47.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.463+0000 7f2cbe6d0640 1 -- 172.21.15.46:0/2838863929 learned_addr learned my addr 172.21.15.46:0/2838863929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.466+0000 7f2cbdecf640 1 -- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80714d0 msgr2=0x7f2cb8150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.466+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80714d0 0x7f2cb8150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.466+0000 7f2cbdecf640 1 -- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 msgr2=0x7f2cb81ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.466+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 0x7f2cb81ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.466+0000 7f2cbdecf640 1 -- 172.21.15.46:0/2838863929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80094d0 con 0x7f2cb80710f0 2024-01-27T14:32:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.468+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 0x7f2cb8156d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e850 tx=0x7f2cb400ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.472+0000 7f2cae7fc640 1 -- 172.21.15.46:0/2838863929 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40095b0 con 0x7f2cb80710f0 2024-01-27T14:32:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.472+0000 7f2cae7fc640 1 -- 172.21.15.46:0/2838863929 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400c940 con 0x7f2cb80710f0 2024-01-27T14:32:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.472+0000 7f2cae7fc640 1 -- 172.21.15.46:0/2838863929 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400ccd0 con 0x7f2cb80710f0 2024-01-27T14:32:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.472+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb81f2e00 con 0x7f2cb80710f0 2024-01-27T14:32:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.472+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81f33c0 con 0x7f2cb80710f0 2024-01-27T14:32:47.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 Processor -- start 2024-01-27T14:32:47.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 -- start start 2024-01-27T14:32:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f626f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f626f5750 0x558f62737670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f62664030 con 0x558f626f5750 2024-01-27T14:32:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f62661720 con 0x558f62736cb0 2024-01-27T14:32:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.475+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f6265d010 con 0x558f62737090 2024-01-27T14:32:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.476+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f626f5750 0x558f62737670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.476+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.476+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55764/0 (socket says 172.21.15.46:55764) 2024-01-27T14:32:47.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.476+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/2190881825 learned_addr learned my addr 172.21.15.46:0/2190881825 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.478+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 msgr2=0x558f626f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.478+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f626f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.479+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/2190881825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f626f5750 msgr2=0x558f62737670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.479+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f626f5750 0x558f62737670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.479+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/2190881825 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f6261f680 con 0x558f62737090 2024-01-27T14:32:47.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.480+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ca802bfb0 tx=0x7f2ca8030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828f8aa8b1749fac server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/2190881825 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030b30 con 0x558f62737090 2024-01-27T14:32:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/2190881825 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8030c90 con 0x558f62737090 2024-01-27T14:32:47.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/2190881825 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8044460 con 0x558f62737090 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 -- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 msgr2=0x558f62735f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ca802bfb0 tx=0x7f2ca8030000 comp rx=0 tx=0).stop 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 -- 172.21.15.46:0/2190881825 shutdown_connections 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62737090 0x558f62735f90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f626f5750 0x558f62737670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/2190881825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f626f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.484+0000 7f2cc2dce740 1 -- 172.21.15.46:0/2190881825 >> 172.21.15.46:0/2190881825 conn(0x558f626f28c0 msgr2=0x558f626f6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.485+0000 7f2cc2dce740 1 -- 172.21.15.46:0/2190881825 shutdown_connections 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.485+0000 7f2cc2dce740 1 -- 172.21.15.46:0/2190881825 wait complete. 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.485+0000 7f2cc2dce740 1 -- start start 2024-01-27T14:32:47.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.485+0000 7f2cc2dce740 1 Processor -- start 2024-01-27T14:32:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62736cb0 0x558f626f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62739860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f626165f0 con 0x558f62736cb0 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f62616290 con 0x558f62737090 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f625db300 con 0x558f627341e0 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cc2dce740 10 client.0 _ll_register_callbacks cb 0x558f62611260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.486+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.487+0000 7f2cbe6d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62736cb0 0x558f626f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.487+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55766/0 (socket says 172.21.15.46:55766) 2024-01-27T14:32:47.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.487+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/3591475103 learned_addr learned my addr 172.21.15.46:0/3591475103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.490+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 msgr2=0x558f62739860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.490+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62739860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.490+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62736cb0 msgr2=0x558f626f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.490+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62736cb0 0x558f626f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.490+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/3591475103 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb8159d40 con 0x558f627341e0 2024-01-27T14:32:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.492+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558f62737bb0 tx=0x7f2ca8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d9329173acd38a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.492+0000 7f2c98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-01-27T14:32:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.492+0000 7f2cae7fc640 1 -- 172.21.15.46:0/2838863929 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2cb4005990 con 0x7f2cb80710f0 2024-01-27T14:32:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.493+0000 7f2cae7fc640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 0x7f2c9c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.493+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 0x7f2c9c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.493+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 0x7f2c9c06d350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0004a80 tx=0x7f2cb0009750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.495+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003610 con 0x558f627341e0 2024-01-27T14:32:47.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.495+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2ca803e040 con 0x558f627341e0 2024-01-27T14:32:47.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.495+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f62655ea0 con 0x558f627341e0 2024-01-27T14:32:47.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.496+0000 7f2cae7fc640 1 -- 172.21.15.46:0/2838863929 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2cb40586c0 con 0x7f2cb80710f0 2024-01-27T14:32:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.497+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca8003770 con 0x558f627341e0 2024-01-27T14:32:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.497+0000 7f2cc2dce740 10 client.4670 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.497+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558f6265b690 con 0x558f627341e0 2024-01-27T14:32:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.501+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f62655ea0 con 0x558f627341e0 2024-01-27T14:32:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.501+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f2ca80038d0 con 0x558f627341e0 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.501+0000 7f2cc2dce740 10 client.4670 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.501+0000 7f2cc2dce740 10 client.4670 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.501+0000 7f2cc2dce740 20 client.4670 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.502+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f6274a360 0x558f6274a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.502+0000 7f2cc2dce740 4 client.4670 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.502+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 --> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f62655bc0 con 0x558f6274a360 2024-01-27T14:32:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.502+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f6274a360 0x558f6274a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.542+0000 7f2c98ff9640 10 client.4670 ms_handle_connect on v2:172.21.15.46:6836/1910346878 2024-01-27T14:32:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.542+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f6274a360 0x558f6274a740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7144b45366249711 server_cookie=fba3f77da50ed8ae in_seq=0 out_seq=0 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2c98ff9640 1 -- 172.21.15.46:0/3591475103 <== mds.2 v2:172.21.15.46:6836/1910346878 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f2cb4056800 con 0x558f6274a360 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2c98ff9640 10 client.4670 handle_command_reply: tid=0 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 client.4670 shutdown 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 msgr2=0x558f6271b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558f62737bb0 tx=0x7f2ca8004730 comp rx=0 tx=0).stop 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 shutdown_connections 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62739860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f6274a360 0x558f6274a740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271b470 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2c98ff9640 0 client.4670 ms_handle_reset on v2:172.21.15.46:6836/1910346878 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/3591475103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62736cb0 0x558f626f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 >> 172.21.15.46:0/3591475103 conn(0x558f626f5750 msgr2=0x558f626f5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.650+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 shutdown_connections 2024-01-27T14:32:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.651+0000 7f2cc2dce740 1 -- 172.21.15.46:0/3591475103 wait complete. 2024-01-27T14:32:47.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.651+0000 7f2cc2dce740 20 client.4670 trim_cache size 0 max 16384 2024-01-27T14:32:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.670+0000 7f2cc2dce740 1 Processor -- start 2024-01-27T14:32:47.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.670+0000 7f2cc2dce740 1 -- start start 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62736cb0 0x558f62750770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62750cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f626106f0 con 0x558f627341e0 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f626ec2e0 con 0x558f62737090 2024-01-27T14:32:47.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.671+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f626ec130 con 0x558f62736cb0 2024-01-27T14:32:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.672+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.672+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62736cb0 0x558f62750770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.672+0000 7f2cbe6d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62750cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.672+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60130/0 (socket says 172.21.15.46:60130) 2024-01-27T14:32:47.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.672+0000 7f2cbdecf640 1 -- 172.21.15.46:0/147141058 learned_addr learned my addr 172.21.15.46:0/147141058 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.674+0000 7f2cbdecf640 1 -- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62736cb0 msgr2=0x558f62750770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.674+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62736cb0 0x558f62750770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.674+0000 7f2cbdecf640 1 -- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 msgr2=0x558f62750cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.674+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62750cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.674+0000 7f2cbdecf640 1 -- 172.21.15.46:0/147141058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f625f8390 con 0x558f627341e0 2024-01-27T14:32:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.676+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4058880 tx=0x7f2cb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7299579b9a787a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.679+0000 7f2c9affd640 1 -- 172.21.15.46:0/147141058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4054dd0 con 0x558f627341e0 2024-01-27T14:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.679+0000 7f2c9affd640 1 -- 172.21.15.46:0/147141058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f62655bc0 con 0x558f627341e0 2024-01-27T14:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.679+0000 7f2c9affd640 1 -- 172.21.15.46:0/147141058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4081e00 con 0x558f627341e0 2024-01-27T14:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 -- 172.21.15.46:0/147141058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 msgr2=0x558f626f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4058880 tx=0x7f2cb4000bc0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 -- 172.21.15.46:0/147141058 shutdown_connections 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62737090 0x558f62750cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f62736cb0 0x558f62750770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/147141058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f627341e0 0x558f626f3da0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 -- 172.21.15.46:0/147141058 >> 172.21.15.46:0/147141058 conn(0x558f626f5750 msgr2=0x558f62737470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 -- 172.21.15.46:0/147141058 shutdown_connections 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.680+0000 7f2cc2dce740 1 -- 172.21.15.46:0/147141058 wait complete. 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.681+0000 7f2cc2dce740 1 -- start start 2024-01-27T14:32:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.681+0000 7f2cc2dce740 1 Processor -- start 2024-01-27T14:32:47.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 0x558f6279be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f6271a9c0 con 0x558f62737090 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f627a2310 con 0x558f62736cb0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f62730a80 con 0x558f627341e0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cc2dce740 10 client.0 _ll_register_callbacks cb 0x7f2cb4009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cbe6d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 0x558f6279be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.682+0000 7f2cbdecf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.683+0000 7f2cbd6ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40720/0 (socket says 172.21.15.46:40720) 2024-01-27T14:32:47.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.683+0000 7f2cbd6ce640 1 -- 172.21.15.46:0/1584327918 learned_addr learned my addr 172.21.15.46:0/1584327918 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbe6d0640 1 -- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 msgr2=0x558f6271a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbe6d0640 1 -- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 msgr2=0x558f6279b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbe6d0640 1 -- 172.21.15.46:0/1584327918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81f33c0 con 0x558f62737090 2024-01-27T14:32:47.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.686+0000 7f2cbd6ce640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:47.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.688+0000 7f2cbe6d0640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 0x558f6279be70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0014f20 tx=0x7f2cb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01aa0de0807e298 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.688+0000 7f2c98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T14:32:47.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.691+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000e040 con 0x558f62737090 2024-01-27T14:32:47.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.691+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2cb0024440 con 0x558f62737090 2024-01-27T14:32:47.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.691+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ca8030c90 con 0x558f62737090 2024-01-27T14:32:47.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.693+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cb0024600 con 0x558f62737090 2024-01-27T14:32:47.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.693+0000 7f2cc2dce740 10 client.4713 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:47.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.693+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558f6261dee0 con 0x558f62737090 2024-01-27T14:32:47.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8030c90 con 0x558f62737090 2024-01-27T14:32:47.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f2cb002a020 con 0x558f62737090 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 10 client.4713 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 10 client.4713 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 20 client.4713 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f62735930 0x558f62735d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 4 client.4713 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.697+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 --> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f6235c6c0 con 0x558f62735930 2024-01-27T14:32:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.698+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f62735930 0x558f62735d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.700+0000 7f2cbdecf640 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f62735930 0x558f62735d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=813de69488e4f48a server_cookie=356dba55181215ac in_seq=0 out_seq=0 2024-01-27T14:32:47.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.700+0000 7f2c98ff9640 10 client.4713 ms_handle_connect on v2:172.21.15.46:6836/1910346878 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2c98ff9640 1 -- 172.21.15.46:0/1584327918 <== mds.2 v2:172.21.15.46:6836/1910346878 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558f6235c6c0 con 0x558f62735930 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2c98ff9640 10 client.4713 handle_command_reply: tid=0 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 client.4713 shutdown 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 msgr2=0x558f6279be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 0x558f6279be70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0014f20 tx=0x7f2cb000b040 comp rx=0 tx=0).stop 2024-01-27T14:32:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 shutdown_connections 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f62736cb0 0x558f6279b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:6836/1910346878,v1:172.21.15.46:6839/1910346878] conn(0x558f62735930 0x558f62735d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f62737090 0x558f6279be70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 --2- 172.21.15.46:0/1584327918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558f627341e0 0x558f6271a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2c98ff9640 0 client.4713 ms_handle_reset on v2:172.21.15.46:6836/1910346878 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.718+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 >> 172.21.15.46:0/1584327918 conn(0x558f626f5750 msgr2=0x558f6273f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 shutdown_connections 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc2dce740 1 -- 172.21.15.46:0/1584327918 wait complete. 2024-01-27T14:32:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc2dce740 20 client.4713 trim_cache size 0 max 16384 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4253, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 20.414372219000001, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 29, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 29, 2024-01-27T14:32:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 64.760758822 2024-01-27T14:32:47.719 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 msgr2=0x7f2c9c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 0x7f2c9c06d350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0004a80 tx=0x7f2cb0009750 comp rx=0 tx=0).stop 2024-01-27T14:32:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 msgr2=0x7f2cb8156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 0x7f2cb8156d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e850 tx=0x7f2cb400ed10 comp rx=0 tx=0).stop 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 shutdown_connections 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c9c06ae90 0x7f2c9c06d350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb80c93b0 0x7f2cb81ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb80714d0 0x7f2cb8150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 --2- 172.21.15.46:0/2838863929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb80710f0 0x7f2cb8156d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 >> 172.21.15.46:0/2838863929 conn(0x7f2cb8066ac0 msgr2=0x7f2cb815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 shutdown_connections 2024-01-27T14:32:47.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.719+0000 7f2cc0133640 1 -- 172.21.15.46:0/2838863929 wait complete. 2024-01-27T14:32:47.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-27T14:32:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.833+0000 7f51f1ba1640 1 Processor -- start 2024-01-27T14:32:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.833+0000 7f51f1ba1640 1 -- start start 2024-01-27T14:32:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f1ba1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51ec1538d0 0x7f51ec0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f1ba1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f1ba1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cc5a0 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f1ba1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0cf120 con 0x7f51ec1538d0 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f1ba1640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0cb450 con 0x7f51ec15a130 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.834+0000 7f51f0b9f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51ec1538d0 0x7f51ec0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.835+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.835+0000 7f51f13a0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f51ec0ca3d0 0x7f51ec0b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:60768/0 (socket says 172.21.15.46:60768) 2024-01-27T14:32:47.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.835+0000 7f51f13a0640 1 -- 172.21.15.46:0/1720164624 learned_addr learned my addr 172.21.15.46:0/1720164624 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:32:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.837+0000 7f51ebfff640 1 -- 172.21.15.46:0/1720164624 >> v2:172.21.15.46:3300/0 conn(0x7f51ec1538d0 msgr2=0x7f51ec0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.837+0000 7f51ebfff640 1 --2- 172.21.15.46:0/1720164624 >> v2:172.21.15.46:3300/0 conn(0x7f51ec1538d0 0x7f51ec0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.837+0000 7f51ebfff640 1 -- 172.21.15.46:0/1720164624 >> v1:172.21.15.73:6789/0 conn(0x7f51ec0ca3d0 legacy=0x7f51ec0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.837+0000 7f51ebfff640 1 -- 172.21.15.46:0/1720164624 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0cb6f0 con 0x7f51ec15a130 2024-01-27T14:32:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.839+0000 7f51ebfff640 1 --2- 172.21.15.46:0/1720164624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c9e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097d0 tx=0x7f51e002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b47bcf878711d26 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51eb7fe640 1 -- 172.21.15.46:0/1720164624 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0031890 con 0x7f51ec15a130 2024-01-27T14:32:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51eb7fe640 1 -- 172.21.15.46:0/1720164624 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e00319f0 con 0x7f51ec15a130 2024-01-27T14:32:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51eb7fe640 1 -- 172.21.15.46:0/1720164624 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0031d80 con 0x7f51ec15a130 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 -- 172.21.15.46:0/1720164624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 msgr2=0x7f51ec0c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/1720164624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c9e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097d0 tx=0x7f51e002b930 comp rx=0 tx=0).stop 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 -- 172.21.15.46:0/1720164624 shutdown_connections 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/1720164624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c9e90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/1720164624 >> v2:172.21.15.46:3300/0 conn(0x7f51ec1538d0 0x7f51ec0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.843+0000 7f51f1ba1640 1 -- 172.21.15.46:0/1720164624 >> 172.21.15.46:0/1720164624 conn(0x7f51ec08af60 msgr2=0x7f51ec08b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.844+0000 7f51f1ba1640 1 -- 172.21.15.46:0/1720164624 shutdown_connections 2024-01-27T14:32:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.844+0000 7f51f1ba1640 1 -- 172.21.15.46:0/1720164624 wait complete. 2024-01-27T14:32:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 Processor -- start 2024-01-27T14:32:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 -- start start 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51ec1538d0 0x7f51ec149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1594a0 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1ef7a0 con 0x7f51ec1538d0 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.845+0000 7f51f1ba1640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1efa80 con 0x7f51ec15a130 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.846+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.846+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.846+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60148/0 (socket says 172.21.15.46:60148) 2024-01-27T14:32:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.846+0000 7f51f0b9f640 1 -- 172.21.15.46:0/2984927034 learned_addr learned my addr 172.21.15.46:0/2984927034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.847+0000 7f51ebfff640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51ec1538d0 0x7f51ec149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.850+0000 7f51f0b9f640 1 -- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 msgr2=0x7f51ec0c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.850+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.850+0000 7f51f0b9f640 1 -- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51ec1538d0 msgr2=0x7f51ec149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.850+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51ec1538d0 0x7f51ec149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.850+0000 7f51f0b9f640 1 -- 172.21.15.46:0/2984927034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0009400 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.852+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51e400efc0 tx=0x7f51e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.855+0000 7f51e97fa640 1 -- 172.21.15.46:0/2984927034 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4014480 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.856+0000 7f51e97fa640 1 -- 172.21.15.46:0/2984927034 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400f040 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.856+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec1efd60 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.856+0000 7f51e97fa640 1 -- 172.21.15.46:0/2984927034 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4014800 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.856+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec1f0320 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.858+0000 7f51f59c6740 1 Processor -- start 2024-01-27T14:32:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.858+0000 7f51f59c6740 1 -- start start 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 0x5570c2a4c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a4b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2979030 con 0x5570c2a4c270 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2976720 con 0x5570c2a0a930 2024-01-27T14:32:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.859+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570c2972010 con 0x5570c2a4be90 2024-01-27T14:32:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.860+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 0x5570c2a4c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.860+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.860+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 0x5570c2a4c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40740/0 (socket says 172.21.15.46:40740) 2024-01-27T14:32:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.860+0000 7f51f0b9f640 1 -- 172.21.15.46:0/468073486 learned_addr learned my addr 172.21.15.46:0/468073486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.862+0000 7f51f13a0640 1 -- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 msgr2=0x5570c2a4c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.862+0000 7f51f13a0640 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 0x5570c2a4c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.862+0000 7f51f13a0640 1 -- 172.21.15.46:0/468073486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 msgr2=0x5570c2a4b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.862+0000 7f51f13a0640 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a4b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.862+0000 7f51f13a0640 1 -- 172.21.15.46:0/468073486 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c2934680 con 0x5570c2a4be90 2024-01-27T14:32:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.864+0000 7f51f13a0640 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0bc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51dc001690 tx=0x7f51dc000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c25ff5414cc2a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.867+0000 7f51d27fc640 1 -- 172.21.15.46:0/468073486 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc001d30 con 0x5570c2a4be90 2024-01-27T14:32:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.867+0000 7f51d27fc640 1 -- 172.21.15.46:0/468073486 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc005ac0 con 0x5570c2a4be90 2024-01-27T14:32:47.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.867+0000 7f51d27fc640 1 -- 172.21.15.46:0/468073486 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc005e30 con 0x5570c2a4be90 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 -- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 msgr2=0x5570c2a0bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0bc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51dc001690 tx=0x7f51dc000ed0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 -- 172.21.15.46:0/468073486 shutdown_connections 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a0a930 0x5570c2a4c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a4b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 --2- 172.21.15.46:0/468073486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0bc30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 -- 172.21.15.46:0/468073486 >> 172.21.15.46:0/468073486 conn(0x5570c2a07aa0 msgr2=0x5570c2a0b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 -- 172.21.15.46:0/468073486 shutdown_connections 2024-01-27T14:32:47.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.868+0000 7f51f59c6740 1 -- 172.21.15.46:0/468073486 wait complete. 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.869+0000 7f51f59c6740 1 -- start start 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.869+0000 7f51f59c6740 1 Processor -- start 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a53950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c292b5f0 con 0x5570c2a4c270 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c292b290 con 0x5570c2a4be90 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570c28f0300 con 0x5570c2a48d30 2024-01-27T14:32:47.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f59c6740 10 client.0 _ll_register_callbacks cb 0x5570c2926260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:47.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.870+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.871+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55824/0 (socket says 172.21.15.46:55824) 2024-01-27T14:32:47.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.871+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40754/0 (socket says 172.21.15.46:40754) 2024-01-27T14:32:47.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.871+0000 7f51ebfff640 1 -- 172.21.15.46:0/3482161624 learned_addr learned my addr 172.21.15.46:0/3482161624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.874+0000 7f51ebfff640 1 -- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 msgr2=0x5570c2a47110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.874+0000 7f51ebfff640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.875+0000 7f51ebfff640 1 -- 172.21.15.46:0/3482161624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 msgr2=0x5570c2a53950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.875+0000 7f51ebfff640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a53950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.875+0000 7f51ebfff640 1 -- 172.21.15.46:0/3482161624 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0cc5a0 con 0x5570c2a48d30 2024-01-27T14:32:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.875+0000 7f51f13a0640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:47.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.876+0000 7f51ebfff640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51e0000c00 tx=0x7f51e0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b632bffaa3122ef server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.876+0000 7f51cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-01-27T14:32:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.877+0000 7f51e97fa640 1 -- 172.21.15.46:0/2984927034 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f51e40149c0 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.878+0000 7f51e97fa640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.878+0000 7f51f13a0640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.878+0000 7f51f13a0640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 0x7f51d806d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51dc015040 tx=0x7f51dc00a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.879+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e003a970 con 0x5570c2a48d30 2024-01-27T14:32:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.880+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f51e003f070 con 0x5570c2a48d30 2024-01-27T14:32:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.880+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570c296aea0 con 0x5570c2a48d30 2024-01-27T14:32:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.881+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e003aad0 con 0x5570c2a48d30 2024-01-27T14:32:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.881+0000 7f51f59c6740 10 client.4688 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.881+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5570c2970690 con 0x5570c2a48d30 2024-01-27T14:32:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.882+0000 7f51e97fa640 1 -- 172.21.15.46:0/2984927034 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f51e4059a00 con 0x7f51ec0ca3d0 2024-01-27T14:32:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570c296aea0 con 0x5570c2a48d30 2024-01-27T14:32:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f51e003ac30 con 0x5570c2a48d30 2024-01-27T14:32:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 10 client.4688 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 10 client.4688 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 20 client.4688 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a321f0 0x5570c2a325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 4 client.4688 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.885+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 --> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570c296abc0 con 0x5570c2a321f0 2024-01-27T14:32:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.886+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a321f0 0x5570c2a325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:47.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.932+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a321f0 0x5570c2a325d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e60c1272acf1aac server_cookie=b1b79a1452ed895 in_seq=0 out_seq=0 2024-01-27T14:32:47.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:47.932+0000 7f51cb7fe640 10 client.4688 ms_handle_connect on v2:172.21.15.73:6834/718826535 2024-01-27T14:32:48.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51cb7fe640 1 -- 172.21.15.46:0/3482161624 <== mds.1 v2:172.21.15.73:6834/718826535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5570c296abc0 con 0x5570c2a321f0 2024-01-27T14:32:48.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51cb7fe640 10 client.4688 handle_command_reply: tid=0 2024-01-27T14:32:48.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 client.4688 shutdown 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 msgr2=0x5570c2a491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51e0000c00 tx=0x7f51e0004730 comp rx=0 tx=0).stop 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 shutdown_connections 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a321f0 0x5570c2a325d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a48d30 0x5570c2a491b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a4c270 0x5570c2a53950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51cb7fe640 0 client.4688 ms_handle_reset on v2:172.21.15.73:6834/718826535 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 --2- 172.21.15.46:0/3482161624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a4be90 0x5570c2a47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 >> 172.21.15.46:0/3482161624 conn(0x5570c2a0a930 msgr2=0x5570c2a33e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 shutdown_connections 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 1 -- 172.21.15.46:0/3482161624 wait complete. 2024-01-27T14:32:48.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.041+0000 7f51f59c6740 20 client.4688 trim_cache size 0 max 16384 2024-01-27T14:32:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.057+0000 7f51f59c6740 1 Processor -- start 2024-01-27T14:32:48.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.057+0000 7f51f59c6740 1 -- start start 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a0a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a0c5a0 con 0x5570c2a48d30 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a47b00 con 0x5570c2a321f0 2024-01-27T14:32:48.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a0c2a0 con 0x5570c2a4be90 2024-01-27T14:32:48.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.058+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.059+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60172/0 (socket says 172.21.15.46:60172) 2024-01-27T14:32:48.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.059+0000 7f51ebfff640 1 -- 172.21.15.46:0/1225964453 learned_addr learned my addr 172.21.15.46:0/1225964453 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.061+0000 7f51ebfff640 1 -- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 msgr2=0x5570c2a601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.061+0000 7f51ebfff640 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.061+0000 7f51ebfff640 1 -- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 msgr2=0x5570c2a0a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.061+0000 7f51ebfff640 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a0a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.061+0000 7f51ebfff640 1 -- 172.21.15.46:0/1225964453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c290d390 con 0x5570c2a48d30 2024-01-27T14:32:48.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.063+0000 7f51ebfff640 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51e004e040 tx=0x7f51e0042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ff817819324e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.066+0000 7f51d1ffb640 1 -- 172.21.15.46:0/1225964453 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004240 con 0x5570c2a48d30 2024-01-27T14:32:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.066+0000 7f51d1ffb640 1 -- 172.21.15.46:0/1225964453 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e00043a0 con 0x5570c2a48d30 2024-01-27T14:32:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.066+0000 7f51d1ffb640 1 -- 172.21.15.46:0/1225964453 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e004b6c0 con 0x5570c2a48d30 2024-01-27T14:32:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 -- 172.21.15.46:0/1225964453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 msgr2=0x5570c2a5fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51e004e040 tx=0x7f51e0042000 comp rx=0 tx=0).stop 2024-01-27T14:32:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 -- 172.21.15.46:0/1225964453 shutdown_connections 2024-01-27T14:32:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a5fcb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 --2- 172.21.15.46:0/1225964453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a0a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 -- 172.21.15.46:0/1225964453 >> 172.21.15.46:0/1225964453 conn(0x5570c2a0a930 msgr2=0x5570c2a28650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 -- 172.21.15.46:0/1225964453 shutdown_connections 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.067+0000 7f51f59c6740 1 -- 172.21.15.46:0/1225964453 wait complete. 2024-01-27T14:32:48.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.068+0000 7f51f59c6740 1 -- start start 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.068+0000 7f51f59c6740 1 Processor -- start 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a34010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a6f580 con 0x5570c2a48d30 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a34550 con 0x5570c2a321f0 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570c2a2f970 con 0x5570c2a4be90 2024-01-27T14:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51f59c6740 10 client.0 _ll_register_callbacks cb 0x7f51dc001260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.069+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.070+0000 7f51f13a0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.070+0000 7f51f0b9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a34010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.070+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60178/0 (socket says 172.21.15.46:60178) 2024-01-27T14:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.070+0000 7f51ebfff640 1 -- 172.21.15.46:0/423191988 learned_addr learned my addr 172.21.15.46:0/423191988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.073+0000 7f51ebfff640 1 -- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 msgr2=0x5570c2a0b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.073+0000 7f51ebfff640 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.073+0000 7f51ebfff640 1 -- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 msgr2=0x5570c2a34010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.073+0000 7f51ebfff640 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a34010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.073+0000 7f51ebfff640 1 -- 172.21.15.46:0/423191988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570c2970690 con 0x5570c2a48d30 2024-01-27T14:32:48.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.075+0000 7f51ebfff640 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51e004b270 tx=0x7f51e0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90d198d11df445a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.075+0000 7f51cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T14:32:48.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.078+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e004b890 con 0x5570c2a48d30 2024-01-27T14:32:48.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.078+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f51e0000e40 con 0x5570c2a48d30 2024-01-27T14:32:48.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.078+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51dc005ac0 con 0x5570c2a48d30 2024-01-27T14:32:48.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.080+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e0004510 con 0x5570c2a48d30 2024-01-27T14:32:48.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.080+0000 7f51f59c6740 10 client.4725 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:48.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.080+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5570c2932ee0 con 0x5570c2a48d30 2024-01-27T14:32:48.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc005ac0 con 0x5570c2a48d30 2024-01-27T14:32:48.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f51e003a770 con 0x5570c2a48d30 2024-01-27T14:32:48.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 10 client.4725 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 10 client.4725 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 20 client.4725 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a4c270 0x5570c2a0b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 4 client.4725 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.084+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 --> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5570c26716c0 con 0x5570c2a4c270 2024-01-27T14:32:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.085+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a4c270 0x5570c2a0b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.088+0000 7f51cb7fe640 10 client.4725 ms_handle_connect on v2:172.21.15.73:6834/718826535 2024-01-27T14:32:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.088+0000 7f51f0b9f640 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a4c270 0x5570c2a0b8c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=538d0c1253f45126 server_cookie=46537a6d0bc8793e in_seq=0 out_seq=0 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.106+0000 7f51cb7fe640 1 -- 172.21.15.46:0/423191988 <== mds.1 v2:172.21.15.73:6834/718826535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5570c26716c0 con 0x5570c2a4c270 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51cb7fe640 10 client.4725 handle_command_reply: tid=0 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 client.4725 shutdown 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 msgr2=0x5570c2a0ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51e004b270 tx=0x7f51e0008030 comp rx=0 tx=0).stop 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 shutdown_connections 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:6834/718826535,v1:172.21.15.73:6835/718826535] conn(0x5570c2a4c270 0x5570c2a0b8c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5570c2a4be90 0x5570c2a0b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5570c2a48d30 0x5570c2a0ae40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51cb7fe640 0 client.4725 ms_handle_reset on v2:172.21.15.73:6834/718826535 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 --2- 172.21.15.46:0/423191988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570c2a321f0 0x5570c2a34010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 >> 172.21.15.46:0/423191988 conn(0x5570c2a0a930 msgr2=0x5570c2a5fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 shutdown_connections 2024-01-27T14:32:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 1 -- 172.21.15.46:0/423191988 wait complete. 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.107+0000 7f51f59c6740 20 client.4725 trim_cache size 0 max 16384 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4261, 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 23.121765697000001, 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-27T14:32:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 29, 2024-01-27T14:32:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 29, 2024-01-27T14:32:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 65.393450662999996 2024-01-27T14:32:48.107 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 msgr2=0x7f51d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 0x7f51d806d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51dc015040 tx=0x7f51dc00a000 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 msgr2=0x7f51ec14d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51e400efc0 tx=0x7f51e400c490 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 shutdown_connections 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f51d806aec0 0x7f51d806d380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51ec1538d0 0x7f51ec149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51ec15a130 0x7f51ec0c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 --2- 172.21.15.46:0/2984927034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51ec0ca3d0 0x7f51ec14d480 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 >> 172.21.15.46:0/2984927034 conn(0x7f51ec08af60 msgr2=0x7f51ec151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 shutdown_connections 2024-01-27T14:32:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.108+0000 7f51f1ba1640 1 -- 172.21.15.46:0/2984927034 wait complete. 2024-01-27T14:32:48.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-27T14:32:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.223+0000 7f62077e3640 1 Processor -- start 2024-01-27T14:32:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.223+0000 7f62077e3640 1 -- start start 2024-01-27T14:32:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.224+0000 7f62077e3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62000ca3d0 0x7f62000ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.224+0000 7f62077e3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62000c9380 0x7f620015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.224+0000 7f62077e3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620015aad0 con 0x7f6200151810 2024-01-27T14:32:48.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.224+0000 7f62077e3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6200158500 con 0x7f62000ca3d0 2024-01-27T14:32:48.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.224+0000 7f62077e3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000c97d0 con 0x7f62000c9380 2024-01-27T14:32:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.252+0000 7f6205d80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62000c9380 0x7f620015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.252+0000 7f6205d80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62000c9380 0x7f620015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40782/0 (socket says 172.21.15.46:40782) 2024-01-27T14:32:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.252+0000 7f6205d80640 1 -- 172.21.15.46:0/1133680007 learned_addr learned my addr 172.21.15.46:0/1133680007 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.253+0000 7f6204d7e640 1 --2- 172.21.15.46:0/1133680007 >> v2:172.21.15.46:3300/0 conn(0x7f62000ca3d0 0x7f62000ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.255+0000 7f6205d80640 1 -- 172.21.15.46:0/1133680007 >> v2:172.21.15.46:3300/0 conn(0x7f62000ca3d0 msgr2=0x7f62000ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.255+0000 7f6205d80640 1 --2- 172.21.15.46:0/1133680007 >> v2:172.21.15.46:3300/0 conn(0x7f62000ca3d0 0x7f62000ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.255+0000 7f6205d80640 1 -- 172.21.15.46:0/1133680007 >> v1:172.21.15.73:6789/0 conn(0x7f6200151810 legacy=0x7f6200070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.255+0000 7f6205d80640 1 -- 172.21.15.46:0/1133680007 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620015b090 con 0x7f62000c9380 2024-01-27T14:32:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.262+0000 7f6205d80640 1 --2- 172.21.15.46:0/1133680007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f620015b520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f620006f090 tx=0x7f61f802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b859b865334e0821 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f61f7fff640 1 -- 172.21.15.46:0/1133680007 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f802cbb0 con 0x7f62000c9380 2024-01-27T14:32:48.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f61f7fff640 1 -- 172.21.15.46:0/1133680007 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f802cd10 con 0x7f62000c9380 2024-01-27T14:32:48.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f61f7fff640 1 -- 172.21.15.46:0/1133680007 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8034610 con 0x7f62000c9380 2024-01-27T14:32:48.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f62077e3640 1 -- 172.21.15.46:0/1133680007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 msgr2=0x7f620015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f62077e3640 1 --2- 172.21.15.46:0/1133680007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f620015b520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f620006f090 tx=0x7f61f802c010 comp rx=0 tx=0).stop 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.266+0000 7f62077e3640 1 -- 172.21.15.46:0/1133680007 shutdown_connections 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.267+0000 7f62077e3640 1 --2- 172.21.15.46:0/1133680007 >> v2:172.21.15.46:3300/0 conn(0x7f62000ca3d0 0x7f62000ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.267+0000 7f62077e3640 1 --2- 172.21.15.46:0/1133680007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f620015b520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.267+0000 7f62077e3640 1 -- 172.21.15.46:0/1133680007 >> 172.21.15.46:0/1133680007 conn(0x7f6200066c80 msgr2=0x7f620006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.267+0000 7f62077e3640 1 -- 172.21.15.46:0/1133680007 shutdown_connections 2024-01-27T14:32:48.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.267+0000 7f62077e3640 1 -- 172.21.15.46:0/1133680007 wait complete. 2024-01-27T14:32:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 Processor -- start 2024-01-27T14:32:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 -- start start 2024-01-27T14:32:48.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f62001573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62000ca3d0 0x7f62001f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200156b40 con 0x7f6200151810 2024-01-27T14:32:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000cafa0 con 0x7f62000c9380 2024-01-27T14:32:48.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.268+0000 7f62077e3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62001578e0 con 0x7f62000ca3d0 2024-01-27T14:32:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.269+0000 7f6205d80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.269+0000 7f620557f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f62001573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.269+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62000ca3d0 0x7f62001f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.269+0000 7f6205d80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60200/0 (socket says 172.21.15.46:60200) 2024-01-27T14:32:48.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.269+0000 7f6205d80640 1 -- 172.21.15.46:0/1382214929 learned_addr learned my addr 172.21.15.46:0/1382214929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f620557f640 1 -- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62000ca3d0 msgr2=0x7f62001f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f620557f640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62000ca3d0 0x7f62001f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f620557f640 1 -- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 msgr2=0x7f6200149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f620557f640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f620557f640 1 -- 172.21.15.46:0/1382214929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8009b30 con 0x7f62000c9380 2024-01-27T14:32:48.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.273+0000 7f6205d80640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:48.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.275+0000 7f620557f640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f62001573a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c3f0 tx=0x7f61fc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.279+0000 7f61f5ffb640 1 -- 172.21.15.46:0/1382214929 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0052d0 con 0x7f62000c9380 2024-01-27T14:32:48.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.279+0000 7f61f5ffb640 1 -- 172.21.15.46:0/1382214929 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc005450 con 0x7f62000c9380 2024-01-27T14:32:48.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.279+0000 7f61f5ffb640 1 -- 172.21.15.46:0/1382214929 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc007260 con 0x7f62000c9380 2024-01-27T14:32:48.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.279+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62000cb240 con 0x7f62000c9380 2024-01-27T14:32:48.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.279+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62001f3480 con 0x7f62000c9380 2024-01-27T14:32:48.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.282+0000 7f620a3a3740 1 Processor -- start 2024-01-27T14:32:48.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.282+0000 7f620a3a3740 1 -- start start 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9ee2750 0x55e9b9f24670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f22f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9e51030 con 0x55e9b9f24090 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9e4e720 con 0x55e9b9ee2750 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9e4a010 con 0x55e9b9f23cb0 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f22f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.283+0000 7f6205d80640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.284+0000 7f6205d80640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:55850/0 (socket says 172.21.15.46:55850) 2024-01-27T14:32:48.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.284+0000 7f6205d80640 1 -- 172.21.15.46:0/1913991305 learned_addr learned my addr 172.21.15.46:0/1913991305 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.286+0000 7f6205d80640 1 -- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9ee2750 msgr2=0x55e9b9f24670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.286+0000 7f6205d80640 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9ee2750 0x55e9b9f24670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.286+0000 7f6205d80640 1 -- 172.21.15.46:0/1913991305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 msgr2=0x55e9b9f22f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.286+0000 7f6205d80640 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f22f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.286+0000 7f6205d80640 1 -- 172.21.15.46:0/1913991305 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9b9e0c680 con 0x55e9b9f23cb0 2024-01-27T14:32:48.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.288+0000 7f6205d80640 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61f80095f0 tx=0x7f61f802e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68c1d4bd780d259 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.291+0000 7f61e2ffd640 1 -- 172.21.15.46:0/1913991305 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f802caf0 con 0x55e9b9f23cb0 2024-01-27T14:32:48.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.291+0000 7f61e2ffd640 1 -- 172.21.15.46:0/1913991305 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f80077a0 con 0x55e9b9f23cb0 2024-01-27T14:32:48.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.291+0000 7f61e2ffd640 1 -- 172.21.15.46:0/1913991305 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8007b10 con 0x55e9b9f23cb0 2024-01-27T14:32:48.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 msgr2=0x55e9b9ee3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61f80095f0 tx=0x7f61f802e000 comp rx=0 tx=0).stop 2024-01-27T14:32:48.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- 172.21.15.46:0/1913991305 shutdown_connections 2024-01-27T14:32:48.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9ee2750 0x55e9b9f24670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f22f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1913991305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9ee3a50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- 172.21.15.46:0/1913991305 >> 172.21.15.46:0/1913991305 conn(0x55e9b9edf8c0 msgr2=0x55e9b9ee3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- 172.21.15.46:0/1913991305 shutdown_connections 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- 172.21.15.46:0/1913991305 wait complete. 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.292+0000 7f620a3a3740 1 -- start start 2024-01-27T14:32:48.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 Processor -- start 2024-01-27T14:32:48.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f23cb0 0x55e9b9f1f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 0x55e9b9f37fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9e035f0 con 0x55e9b9f384e0 2024-01-27T14:32:48.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9e03290 con 0x55e9b9f23cb0 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.293+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9dc8300 con 0x55e9b9f24090 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.294+0000 7f620a3a3740 10 client.0 _ll_register_callbacks cb 0x55e9b9dfe260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.294+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.294+0000 7f620557f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 0x55e9b9f37fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.294+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60218/0 (socket says 172.21.15.46:60218) 2024-01-27T14:32:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.294+0000 7f6204d7e640 1 -- 172.21.15.46:0/2918295589 learned_addr learned my addr 172.21.15.46:0/2918295589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f620557f640 1 -- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f23cb0 msgr2=0x55e9b9f1f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f620557f640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f23cb0 0x55e9b9f1f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f620557f640 1 -- 172.21.15.46:0/2918295589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 msgr2=0x55e9b9f09f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f620557f640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f620557f640 1 -- 172.21.15.46:0/2918295589 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620015b090 con 0x55e9b9f24090 2024-01-27T14:32:48.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.297+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:48.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.299+0000 7f61f5ffb640 1 -- 172.21.15.46:0/1382214929 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f61fc003b40 con 0x7f62000c9380 2024-01-27T14:32:48.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.299+0000 7f61f5ffb640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 0x7f61e406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.299+0000 7f6205d80640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 0x7f61e406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.300+0000 7f6205d80640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 0x7f61e406d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61f8036040 tx=0x7f61f8009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.300+0000 7f620557f640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 0x55e9b9f37fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c3c0 tx=0x7f61fc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d902e201349bff0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.300+0000 7f61dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-01-27T14:32:48.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.303+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc001000 con 0x55e9b9f24090 2024-01-27T14:32:48.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.303+0000 7f61f5ffb640 1 -- 172.21.15.46:0/1382214929 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f61fc060130 con 0x7f62000c9380 2024-01-27T14:32:48.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.303+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f61fc093070 con 0x55e9b9f24090 2024-01-27T14:32:48.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.303+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9b9e42ea0 con 0x55e9b9f24090 2024-01-27T14:32:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.305+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61fc05bd70 con 0x55e9b9f24090 2024-01-27T14:32:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.305+0000 7f620a3a3740 10 client.4703 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.305+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e9b9e48690 con 0x55e9b9f24090 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc077020 con 0x55e9b9f24090 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f61fc024070 con 0x55e9b9f24090 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 10 client.4703 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 10 client.4703 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 20 client.4703 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f34c60 0x55e9b9f35040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 4 client.4703 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.309+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 --> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9b9e42bc0 con 0x55e9b9f34c60 2024-01-27T14:32:48.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.310+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f34c60 0x55e9b9f35040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.313+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f34c60 0x55e9b9f35040 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38f8292574cad313 server_cookie=25cf09325f8de888 in_seq=0 out_seq=0 2024-01-27T14:32:48.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.313+0000 7f61dbfff640 10 client.4703 ms_handle_connect on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f61dbfff640 1 -- 172.21.15.46:0/2918295589 <== mds.0 v2:172.21.15.73:6836/2525471575 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9b9e42bc0 con 0x55e9b9f34c60 2024-01-27T14:32:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f61dbfff640 10 client.4703 handle_command_reply: tid=0 2024-01-27T14:32:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 client.4703 shutdown 2024-01-27T14:32:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 msgr2=0x55e9b9f37fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 0x55e9b9f37fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c3c0 tx=0x7f61fc000bc0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 shutdown_connections 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f34c60 0x55e9b9f35040 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f09f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f24090 0x55e9b9f37fa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2918295589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f23cb0 0x55e9b9f1f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f61dbfff640 0 client.4703 ms_handle_reset on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 >> 172.21.15.46:0/2918295589 conn(0x55e9b9ee2750 msgr2=0x55e9b9ee2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 shutdown_connections 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 1 -- 172.21.15.46:0/2918295589 wait complete. 2024-01-27T14:32:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.332+0000 7f620a3a3740 20 client.4703 trim_cache size 0 max 16384 2024-01-27T14:32:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 Processor -- start 2024-01-27T14:32:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 -- start start 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f0c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f1fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 0x55e9b9f203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9f0c920 con 0x55e9b9f24090 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9f1e900 con 0x55e9b9f384e0 2024-01-27T14:32:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.348+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9f04600 con 0x55e9b9f23cb0 2024-01-27T14:32:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.349+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f1fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.349+0000 7f6205d80640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 0x55e9b9f203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.349+0000 7f620557f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f0c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.349+0000 7f6205d80640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 0x55e9b9f203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40834/0 (socket says 172.21.15.46:40834) 2024-01-27T14:32:48.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.349+0000 7f6205d80640 1 -- 172.21.15.46:0/2521743988 learned_addr learned my addr 172.21.15.46:0/2521743988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.351+0000 7f6204d7e640 1 -- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 msgr2=0x55e9b9f0c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.351+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f0c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.351+0000 7f6204d7e640 1 -- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 msgr2=0x55e9b9f203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.351+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 0x55e9b9f203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.351+0000 7f6204d7e640 1 -- 172.21.15.46:0/2521743988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9b9de5390 con 0x55e9b9f24090 2024-01-27T14:32:48.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.353+0000 7f6204d7e640 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f1fe60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55e9b9f35640 tx=0x7f61f0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b4515a61c4907 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f61e27fc640 1 -- 172.21.15.46:0/2521743988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f001a040 con 0x55e9b9f24090 2024-01-27T14:32:48.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f61e27fc640 1 -- 172.21.15.46:0/2521743988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f001c040 con 0x55e9b9f24090 2024-01-27T14:32:48.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f61e27fc640 1 -- 172.21.15.46:0/2521743988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00040f0 con 0x55e9b9f24090 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 -- 172.21.15.46:0/2521743988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 msgr2=0x55e9b9f1fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f1fe60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55e9b9f35640 tx=0x7f61f0009190 comp rx=0 tx=0).stop 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 -- 172.21.15.46:0/2521743988 shutdown_connections 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f384e0 0x55e9b9f203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f24090 0x55e9b9f1fe60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 --2- 172.21.15.46:0/2521743988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f0c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 -- 172.21.15.46:0/2521743988 >> 172.21.15.46:0/2521743988 conn(0x55e9b9ee2750 msgr2=0x55e9b9f28040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 -- 172.21.15.46:0/2521743988 shutdown_connections 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.357+0000 7f620a3a3740 1 -- 172.21.15.46:0/2521743988 wait complete. 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.358+0000 7f620a3a3740 1 -- start start 2024-01-27T14:32:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.358+0000 7f620a3a3740 1 Processor -- start 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f24090 0x55e9b9f33d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9f479f0 con 0x55e9b9f384e0 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9f36d10 con 0x55e9b9f24090 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9b9ee2fb0 con 0x55e9b9f23cb0 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f620a3a3740 10 client.0 _ll_register_callbacks cb 0x7f61f8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.359+0000 7f6205d80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.360+0000 7f6204d7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f24090 0x55e9b9f33d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.360+0000 7f6205d80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60236/0 (socket says 172.21.15.46:60236) 2024-01-27T14:32:48.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.360+0000 7f6205d80640 1 -- 172.21.15.46:0/1770342604 learned_addr learned my addr 172.21.15.46:0/1770342604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.360+0000 7f620557f640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.363+0000 7f6205d80640 1 -- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 msgr2=0x55e9b9f367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.363+0000 7f6205d80640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.363+0000 7f6205d80640 1 -- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f24090 msgr2=0x55e9b9f33d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.363+0000 7f6205d80640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f24090 0x55e9b9f33d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.363+0000 7f6205d80640 1 -- 172.21.15.46:0/1770342604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9b9e0aee0 con 0x55e9b9f384e0 2024-01-27T14:32:48.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.365+0000 7f6205d80640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61f8008bb0 tx=0x7f61f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6537e9cce2897 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.365+0000 7f61dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T14:32:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.368+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8004450 con 0x55e9b9f384e0 2024-01-27T14:32:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.368+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f61f8051040 con 0x55e9b9f384e0 2024-01-27T14:32:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.368+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f80077a0 con 0x55e9b9f384e0 2024-01-27T14:32:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.370+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f8008e50 con 0x55e9b9f384e0 2024-01-27T14:32:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.370+0000 7f620a3a3740 10 client.4743 fetch_fsmap learned FSMap version 18 2024-01-27T14:32:48.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.370+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e9b9df1800 con 0x55e9b9f384e0 2024-01-27T14:32:48.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f80077a0 con 0x55e9b9f384e0 2024-01-27T14:32:48.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f61f803c050 con 0x55e9b9f384e0 2024-01-27T14:32:48.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 10 client.4743 fetch_fsmap finished waiting for FSMap version 18 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 10 client.4743 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 20 client.4743 populate_metadata read hostname 'smithi046' 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f03ca0 0x55e9b9f89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 4 client.4743 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.373+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 --> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9b9b496c0 con 0x55e9b9f03ca0 2024-01-27T14:32:48.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.374+0000 7f620557f640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f03ca0 0x55e9b9f89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.377+0000 7f61dbfff640 10 client.4743 ms_handle_connect on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.377+0000 7f620557f640 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f03ca0 0x55e9b9f89b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=432988e7ab1154e8 server_cookie=b6b3982936ca0118 in_seq=0 out_seq=0 2024-01-27T14:32:48.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f61dbfff640 1 -- 172.21.15.46:0/1770342604 <== mds.0 v2:172.21.15.73:6836/2525471575 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e9b9b496c0 con 0x55e9b9f03ca0 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f61dbfff640 10 client.4743 handle_command_reply: tid=0 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 client.4743 shutdown 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 msgr2=0x55e9b9f20160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61f8008bb0 tx=0x7f61f8004ab0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 shutdown_connections 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:6836/2525471575,v1:172.21.15.73:6837/2525471575] conn(0x55e9b9f03ca0 0x55e9b9f89b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9b9f24090 0x55e9b9f33d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e9b9f384e0 0x55e9b9f20160 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f61dbfff640 0 client.4743 ms_handle_reset on v2:172.21.15.73:6836/2525471575 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 --2- 172.21.15.46:0/1770342604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e9b9f23cb0 0x55e9b9f367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 >> 172.21.15.46:0/1770342604 conn(0x55e9b9ee2750 msgr2=0x55e9b9f27fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.380+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 shutdown_connections 2024-01-27T14:32:48.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f620a3a3740 1 -- 172.21.15.46:0/1770342604 wait complete. 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f620a3a3740 20 client.4743 trim_cache size 0 max 16384 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "00cf821c-af7b-4286-9602-7ecfadc2291e", 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4267, 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 55.747559344000003, 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-27T14:32:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 29, 2024-01-27T14:32:48.380 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 29, 2024-01-27T14:32:48.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 65.522726012999996 2024-01-27T14:32:48.380 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:48.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 msgr2=0x7f61e406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 0x7f61e406d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61f8036040 tx=0x7f61f8009000 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 msgr2=0x7f62001573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f62001573a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c3f0 tx=0x7f61fc00c8b0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 shutdown_connections 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f61e406aec0 0x7f61e406d380 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6200151810 0x7f6200149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62000ca3d0 0x7f62001f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 --2- 172.21.15.46:0/1382214929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62000c9380 0x7f62001573a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 >> 172.21.15.46:0/1382214929 conn(0x7f6200066c80 msgr2=0x7f6200159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 shutdown_connections 2024-01-27T14:32:48.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.381+0000 7f62077e3640 1 -- 172.21.15.46:0/1382214929 wait complete. 2024-01-27T14:32:48.392 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-27T14:32:48.405 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-27T14:32:48.405 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-01-27T14:32:48.405 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-27T14:32:48.405 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-27T14:32:48.405 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:48.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:48.406 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T14:32:48.420 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-27T14:32:48.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:48.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T14:32:48.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:48.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-27T14:32:48.579 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-27T14:32:48.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-27T14:32:48.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.687+0000 7ff7d3fc9640 1 Processor -- start 2024-01-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.687+0000 7ff7d3fc9640 1 -- start start 2024-01-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d3fc9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7cc06e010 0x7ff7cc0c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d3fc9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 0x7ff7cc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d3fc9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc072300 con 0x7ff7cc14cd60 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d3fc9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc156630 con 0x7ff7cc06d2b0 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d3fc9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc06e450 con 0x7ff7cc06e010 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d2566640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 0x7ff7cc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.688+0000 7ff7d1564640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7cc06e010 0x7ff7cc0c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.689+0000 7ff7d2566640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 0x7ff7cc06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60252/0 (socket says 172.21.15.46:60252) 2024-01-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.689+0000 7ff7d2566640 1 -- 172.21.15.46:0/3445907383 learned_addr learned my addr 172.21.15.46:0/3445907383 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.691+0000 7ff7d1564640 1 -- 172.21.15.46:0/3445907383 >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 msgr2=0x7ff7cc06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.691+0000 7ff7d1564640 1 --2- 172.21.15.46:0/3445907383 >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 0x7ff7cc06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.691+0000 7ff7d1564640 1 -- 172.21.15.46:0/3445907383 >> v1:172.21.15.46:6789/0 conn(0x7ff7cc14cd60 legacy=0x7ff7cc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.691+0000 7ff7d1564640 1 -- 172.21.15.46:0/3445907383 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc1571d0 con 0x7ff7cc06e010 2024-01-27T14:32:48.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.693+0000 7ff7d1564640 1 --2- 172.21.15.46:0/3445907383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc0c0000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc06d240 tx=0x7ff7bc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694a1996da851d3f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d0d63640 1 -- 172.21.15.46:0/3445907383 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc030610 con 0x7ff7cc06e010 2024-01-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d0d63640 1 -- 172.21.15.46:0/3445907383 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc030770 con 0x7ff7cc06e010 2024-01-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d0d63640 1 -- 172.21.15.46:0/3445907383 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc030b00 con 0x7ff7cc06e010 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/3445907383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 msgr2=0x7ff7cc0c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/3445907383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc0c0000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc06d240 tx=0x7ff7bc02b960 comp rx=0 tx=0).stop 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/3445907383 shutdown_connections 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/3445907383 >> v2:172.21.15.46:3300/0 conn(0x7ff7cc06d2b0 0x7ff7cc06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/3445907383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc0c0000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/3445907383 >> 172.21.15.46:0/3445907383 conn(0x7ff7cc0cafe0 msgr2=0x7ff7cc0cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.697+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/3445907383 shutdown_connections 2024-01-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.698+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/3445907383 wait complete. 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 Processor -- start 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 -- start start 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7cc06d2b0 0x7ff7cc141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc1ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1416a0 con 0x7ff7cc14cd60 2024-01-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc147500 con 0x7ff7cc06e010 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.699+0000 7ff7d3fc9640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1428a0 con 0x7ff7cc06d2b0 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.700+0000 7ff7d2566640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.700+0000 7ff7d1564640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc1ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.700+0000 7ff7d1d65640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7cc06d2b0 0x7ff7cc141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.700+0000 7ff7d2566640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60266/0 (socket says 172.21.15.46:60266) 2024-01-27T14:32:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.700+0000 7ff7d2566640 1 -- 172.21.15.46:0/2928174441 learned_addr learned my addr 172.21.15.46:0/2928174441 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:32:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d1564640 1 -- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7cc06d2b0 msgr2=0x7ff7cc141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d1564640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7cc06d2b0 0x7ff7cc141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d1564640 1 -- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 msgr2=0x7ff7cc143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d1564640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d1564640 1 -- 172.21.15.46:0/2928174441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009400 con 0x7ff7cc06e010 2024-01-27T14:32:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.704+0000 7ff7d2566640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:32:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.707+0000 7ff7d1564640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc1ed430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc033000 tx=0x7ff7bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.711+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc03e040 con 0x7ff7cc06e010 2024-01-27T14:32:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.711+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc039cb0 con 0x7ff7cc06e010 2024-01-27T14:32:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.711+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc1477a0 con 0x7ff7cc06e010 2024-01-27T14:32:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.711+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc044630 con 0x7ff7cc06e010 2024-01-27T14:32:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.711+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc147a60 con 0x7ff7cc06e010 2024-01-27T14:32:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.712+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0742e0 con 0x7ff7cc06e010 2024-01-27T14:32:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.951+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff7bc04d3b0 con 0x7ff7cc06e010 2024-01-27T14:32:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.951+0000 7ff7c27fc640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 0x7ff7b006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:32:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.951+0000 7ff7d1d65640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 0x7ff7b006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:32:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.952+0000 7ff7d1d65640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 0x7ff7b006d3e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80016e0 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.954+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff7bc039e20 con 0x7ff7cc06e010 2024-01-27T14:32:48.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:48.964+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff7bc076f00 con 0x7ff7cc06e010 2024-01-27T14:32:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.203+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7cc1506c0 con 0x7ff7cc06e010 2024-01-27T14:32:49.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.209+0000 7ff7c27fc640 1 -- 172.21.15.46:0/2928174441 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff7bc034070 con 0x7ff7cc06e010 2024-01-27T14:32:49.206 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.211+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 msgr2=0x7ff7b006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.211+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 0x7ff7b006d3e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80016e0 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.211+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 msgr2=0x7ff7cc1ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.211+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc1ed430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc033000 tx=0x7ff7bc004730 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 shutdown_connections 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff7b006af20 0x7ff7b006d3e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7cc06e010 0x7ff7cc1ed430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc14cd60 0x7ff7cc143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 --2- 172.21.15.46:0/2928174441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7cc06d2b0 0x7ff7cc141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 >> 172.21.15.46:0/2928174441 conn(0x7ff7cc0cafe0 msgr2=0x7ff7cc0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:32:49.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 shutdown_connections 2024-01-27T14:32:49.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:49.212+0000 7ff7d3fc9640 1 -- 172.21.15.46:0/2928174441 wait complete. 2024-01-27T14:32:49.219 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-27T14:32:49.220 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-27T14:32:49.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.220 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-27T14:32:49.236 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-27T14:32:49.236 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-27T14:32:49.236 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-27T14:32:49.238 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T14:32:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-27T14:32:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-27T14:32:49.238 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-27T14:32:49.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.238 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:49.238 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:49.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-27T14:32:49.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-27T14:32:49.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-27T14:32:49.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-27T14:32:49.239 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:49.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.347 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-27T14:32:49.373 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-27T14:32:49.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.375 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-27T14:32:49.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:49.432 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:49.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-27T14:32:49.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-27T14:32:49.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-27T14:32:49.432 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:49.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.526 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T14:32:49.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.541 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-27T14:32:49.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:49.595 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:49.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:49.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-27T14:32:49.596 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:49.679 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-27T14:32:49.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.679 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:49.679 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-27T14:32:49.680 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:49.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:49.804 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T14:32:49.804 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T14:32:49.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-27T14:32:49.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-27T14:32:49.805 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T14:32:49.845 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-27T14:32:49.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T14:32:49.846 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:49.900 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-27T14:32:49.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T14:32:49.901 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:49.954 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T14:32:49.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:50.022 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:50.077 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:50.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:50.080 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:50.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-27T14:32:50.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-27T14:32:50.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:50.201 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:50.257 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:50.258 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:50.260 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:50.260 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:50.260 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:50.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:50.260 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:51.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:51.441 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:51.497 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:51.497 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:51.497 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:51.497 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:51.497 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:51.498 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:51.499 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:51.500 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:51.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:51.500 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:52.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:52.682 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:52.738 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:52.739 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:52.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:52.740 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:53.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:53.924 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:53.980 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:53.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:53.982 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:55.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:55.163 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:55.218 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:55.219 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:55.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:55.220 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:56.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[47624]: starting ceph client 2024-01-27T14:32:56.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-01-27T14:32:55.997+0000 64f7100 -1 init, newargv = 0x7a01ca0 newargc=15 2024-01-27T14:32:56.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:56.401 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:56.457 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:56.458 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:56.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:56.459 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:57.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[47624]: starting fuse 2024-01-27T14:32:57.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T14:32:57.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:32:57.643 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T14:32:57.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T14:32:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T14:32:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:32:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:57.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:57.702 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T14:32:57.793 INFO:teuthology.orchestra.run.smithi046.stdout:42 2024-01-27T14:32:57.793 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-27T14:32:57.793 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-27T14:32:57.794 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T14:32:57.795 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-01-27T14:32:57.795 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-27T14:32:57.912 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.47624.asok 2024-01-27T14:32:57.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-27T14:32:57.923 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47624.asok 2024-01-27T14:32:57.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:57.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47624.asok status 2024-01-27T14:32:58.163 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "99a21c3b6c137f933ecc0074a260e59bd4ba2a7f", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-880-g99a21c3b (99a21c3b6c137f933ecc0074a260e59bd4ba2a7f) squid (dev)", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "47624", 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-27T14:32:58.164 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4795, 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4795 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2537456405 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T14:32:58.165 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2537456405 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4795 172.21.15.46:0/2537456405", 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "172.21.15.46:0/2537456405", 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 18, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 29, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-27T14:32:58.166 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:32:58.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:58.173 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-27T14:32:58.173 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.226 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-27T14:32:58.226 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:32:58.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.278 INFO:teuthology.run_tasks:Running task workunit... 2024-01-27T14:32:58.291 INFO:tasks.workunit:Pulling workunits from ref 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:32:58.292 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-27T14:32:58.292 INFO:tasks.workunit:timeout=3h 2024-01-27T14:32:58.292 INFO:tasks.workunit:cleanup=True 2024-01-27T14:32:58.292 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 14:31:52.911938152 +0000 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 14:32:06.990225656 +0000 2024-01-27T14:32:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-27T14:32:58.308 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-27T14:32:58.308 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-27T14:32:58.953 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T14:32:58.968 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-27T14:33:27.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:33:27.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:33:44.519 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 98% (11884/12104) Updating files: 99% (11983/12104) Updating files: 100% (12104/12104) Updating files: 100% (12104/12104), done. 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'. 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-27T14:33:45.231 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T14:33:45.232 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 99a21c3b6c1 Merge pull request #55308 from ljflores/wip-dependabot 2024-01-27T14:33:45.235 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-27T14:33:45.255 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-27T14:33:45.257 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-27T14:33:45.257 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-27T14:33:45.892 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-27T14:33:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-27T14:33:46.003 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-27T14:33:46.004 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-27T14:33:46.004 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-27T14:33:46.044 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-27T14:33:46.047 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:33:46.047 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-27T14:33:46.102 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-01-27T14:33:46.103 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-01-27T14:33:46.104 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-01-27T14:33:46.406 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 1 2024-01-27T14:33:46.411 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-27T14:33:46.412 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:33:46.412 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-27T14:33:46.418 INFO:tasks.workunit.client.0.smithi046.stdout:0 of 1 processes prepared for launch 0 sec 2024-01-27T14:33:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:1 of 1 processes prepared for launch 0 sec 2024-01-27T14:33:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-27T14:33:47.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 23.162 ms 2024-01-27T14:33:48.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 111 2.62 MB/sec warmup 2 sec latency 240.925 ms 2024-01-27T14:33:49.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 155 2.18 MB/sec warmup 3 sec latency 163.860 ms 2024-01-27T14:33:50.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 197 1.96 MB/sec warmup 4 sec latency 178.499 ms 2024-01-27T14:33:51.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 239 1.83 MB/sec warmup 5 sec latency 166.051 ms 2024-01-27T14:33:52.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 287 1.78 MB/sec warmup 6 sec latency 169.749 ms 2024-01-27T14:33:53.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 323 1.68 MB/sec warmup 7 sec latency 169.886 ms 2024-01-27T14:33:54.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 365 1.63 MB/sec warmup 8 sec latency 249.631 ms 2024-01-27T14:33:55.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 405 1.59 MB/sec warmup 9 sec latency 233.190 ms 2024-01-27T14:33:56.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 437 1.54 MB/sec warmup 10 sec latency 246.771 ms 2024-01-27T14:33:57.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 477 1.52 MB/sec warmup 11 sec latency 242.511 ms 2024-01-27T14:33:57.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:33:57.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:33:58.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 511 1.48 MB/sec warmup 12 sec latency 305.936 ms 2024-01-27T14:33:59.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 603 1.61 MB/sec warmup 13 sec latency 229.108 ms 2024-01-27T14:34:00.519 INFO:tasks.workunit.client.0.smithi046.stdout: 1 614 1.50 MB/sec warmup 14 sec latency 306.020 ms 2024-01-27T14:34:01.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 645 1.40 MB/sec warmup 15 sec latency 381.474 ms 2024-01-27T14:34:02.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 655 1.32 MB/sec warmup 16 sec latency 409.607 ms 2024-01-27T14:34:03.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 682 1.25 MB/sec warmup 17 sec latency 311.112 ms 2024-01-27T14:34:04.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 710 1.18 MB/sec warmup 18 sec latency 361.208 ms 2024-01-27T14:34:05.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 744 1.12 MB/sec warmup 19 sec latency 366.208 ms 2024-01-27T14:34:06.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 778 1.07 MB/sec warmup 20 sec latency 310.385 ms 2024-01-27T14:34:07.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 812 1.02 MB/sec warmup 21 sec latency 234.708 ms 2024-01-27T14:34:08.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 823 0.98 MB/sec warmup 22 sec latency 328.885 ms 2024-01-27T14:34:09.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 854 0.94 MB/sec warmup 23 sec latency 389.666 ms 2024-01-27T14:34:10.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 870 0.90 MB/sec warmup 24 sec latency 364.058 ms 2024-01-27T14:34:11.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 902 0.87 MB/sec warmup 25 sec latency 305.687 ms 2024-01-27T14:34:12.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 928 0.84 MB/sec warmup 26 sec latency 327.602 ms 2024-01-27T14:34:13.520 INFO:tasks.workunit.client.0.smithi046.stdout: 1 934 0.81 MB/sec warmup 27 sec latency 309.844 ms 2024-01-27T14:34:14.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 964 0.78 MB/sec warmup 28 sec latency 298.849 ms 2024-01-27T14:34:15.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 994 0.76 MB/sec warmup 29 sec latency 242.744 ms 2024-01-27T14:34:16.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1032 0.76 MB/sec warmup 30 sec latency 311.179 ms 2024-01-27T14:34:17.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1047 0.74 MB/sec warmup 31 sec latency 314.506 ms 2024-01-27T14:34:18.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1061 0.72 MB/sec warmup 32 sec latency 341.574 ms 2024-01-27T14:34:19.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1095 0.70 MB/sec warmup 33 sec latency 327.029 ms 2024-01-27T14:34:20.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1116 0.68 MB/sec warmup 34 sec latency 313.822 ms 2024-01-27T14:34:21.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1156 0.66 MB/sec warmup 35 sec latency 195.013 ms 2024-01-27T14:34:22.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1169 0.64 MB/sec warmup 36 sec latency 316.212 ms 2024-01-27T14:34:23.521 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1179 0.62 MB/sec warmup 37 sec latency 307.837 ms 2024-01-27T14:34:24.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1211 0.61 MB/sec warmup 38 sec latency 312.440 ms 2024-01-27T14:34:25.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1244 0.59 MB/sec warmup 39 sec latency 210.681 ms 2024-01-27T14:34:26.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1277 0.58 MB/sec warmup 40 sec latency 344.240 ms 2024-01-27T14:34:27.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1281 0.56 MB/sec warmup 41 sec latency 342.979 ms 2024-01-27T14:34:27.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:34:27.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:34:28.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1376 0.62 MB/sec warmup 42 sec latency 318.074 ms 2024-01-27T14:34:29.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1385 0.60 MB/sec warmup 43 sec latency 392.238 ms 2024-01-27T14:34:30.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1397 0.59 MB/sec warmup 44 sec latency 306.490 ms 2024-01-27T14:34:31.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1424 0.58 MB/sec warmup 45 sec latency 331.324 ms 2024-01-27T14:34:32.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1449 0.57 MB/sec warmup 46 sec latency 292.566 ms 2024-01-27T14:34:33.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1485 0.55 MB/sec warmup 47 sec latency 328.964 ms 2024-01-27T14:34:34.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1497 0.54 MB/sec warmup 48 sec latency 335.844 ms 2024-01-27T14:34:35.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1526 0.53 MB/sec warmup 49 sec latency 167.958 ms 2024-01-27T14:34:36.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1552 0.52 MB/sec warmup 50 sec latency 301.402 ms 2024-01-27T14:34:37.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1580 0.51 MB/sec warmup 51 sec latency 299.834 ms 2024-01-27T14:34:38.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1605 0.50 MB/sec warmup 52 sec latency 312.074 ms 2024-01-27T14:34:39.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1616 0.49 MB/sec warmup 53 sec latency 347.713 ms 2024-01-27T14:34:40.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1643 0.49 MB/sec warmup 54 sec latency 312.386 ms 2024-01-27T14:34:41.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1680 0.48 MB/sec warmup 55 sec latency 331.814 ms 2024-01-27T14:34:42.522 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1701 0.47 MB/sec warmup 56 sec latency 266.657 ms 2024-01-27T14:34:43.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1758 0.46 MB/sec warmup 57 sec latency 299.393 ms 2024-01-27T14:34:44.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1795 0.45 MB/sec warmup 58 sec latency 316.994 ms 2024-01-27T14:34:45.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1822 0.45 MB/sec warmup 59 sec latency 311.490 ms 2024-01-27T14:34:46.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1840 0.44 MB/sec warmup 60 sec latency 307.015 ms 2024-01-27T14:34:47.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1859 0.43 MB/sec warmup 61 sec latency 334.566 ms 2024-01-27T14:34:48.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1869 0.43 MB/sec warmup 62 sec latency 304.258 ms 2024-01-27T14:34:49.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1903 0.42 MB/sec warmup 63 sec latency 458.364 ms 2024-01-27T14:34:50.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1920 0.41 MB/sec warmup 64 sec latency 317.742 ms 2024-01-27T14:34:51.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1975 0.41 MB/sec warmup 65 sec latency 307.766 ms 2024-01-27T14:34:52.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2006 0.40 MB/sec warmup 66 sec latency 300.650 ms 2024-01-27T14:34:53.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2043 0.40 MB/sec warmup 67 sec latency 309.267 ms 2024-01-27T14:34:54.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2058 0.39 MB/sec warmup 68 sec latency 305.345 ms 2024-01-27T14:34:55.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2080 0.39 MB/sec warmup 69 sec latency 332.986 ms 2024-01-27T14:34:56.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2096 0.38 MB/sec warmup 70 sec latency 320.460 ms 2024-01-27T14:34:57.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2140 0.38 MB/sec warmup 71 sec latency 351.601 ms 2024-01-27T14:34:58.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:34:58.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:34:58.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2173 0.37 MB/sec warmup 72 sec latency 351.223 ms 2024-01-27T14:34:59.523 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2181 0.37 MB/sec warmup 73 sec latency 471.356 ms 2024-01-27T14:35:00.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2212 0.36 MB/sec warmup 74 sec latency 327.273 ms 2024-01-27T14:35:01.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2282 0.36 MB/sec warmup 75 sec latency 294.663 ms 2024-01-27T14:35:02.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2303 0.37 MB/sec warmup 76 sec latency 279.727 ms 2024-01-27T14:35:03.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2321 0.36 MB/sec warmup 77 sec latency 318.790 ms 2024-01-27T14:35:04.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2335 0.36 MB/sec warmup 78 sec latency 310.909 ms 2024-01-27T14:35:05.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2358 0.35 MB/sec warmup 79 sec latency 310.536 ms 2024-01-27T14:35:06.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2364 0.35 MB/sec warmup 80 sec latency 542.902 ms 2024-01-27T14:35:07.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2371 0.34 MB/sec warmup 81 sec latency 347.242 ms 2024-01-27T14:35:08.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2391 0.34 MB/sec warmup 82 sec latency 349.538 ms 2024-01-27T14:35:09.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2407 0.34 MB/sec warmup 83 sec latency 433.082 ms 2024-01-27T14:35:10.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2431 0.33 MB/sec warmup 84 sec latency 301.153 ms 2024-01-27T14:35:11.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2440 0.33 MB/sec warmup 85 sec latency 316.667 ms 2024-01-27T14:35:12.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2470 0.33 MB/sec warmup 86 sec latency 164.200 ms 2024-01-27T14:35:13.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2492 0.33 MB/sec warmup 87 sec latency 326.108 ms 2024-01-27T14:35:14.524 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2506 0.33 MB/sec warmup 88 sec latency 324.414 ms 2024-01-27T14:35:15.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2558 0.32 MB/sec warmup 89 sec latency 310.834 ms 2024-01-27T14:35:16.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2577 0.32 MB/sec warmup 90 sec latency 284.513 ms 2024-01-27T14:35:17.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2591 0.32 MB/sec warmup 91 sec latency 345.141 ms 2024-01-27T14:35:18.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2604 0.32 MB/sec warmup 92 sec latency 328.338 ms 2024-01-27T14:35:19.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2617 0.31 MB/sec warmup 93 sec latency 319.605 ms 2024-01-27T14:35:20.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2718 0.34 MB/sec warmup 94 sec latency 320.351 ms 2024-01-27T14:35:21.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2752 0.34 MB/sec warmup 95 sec latency 304.834 ms 2024-01-27T14:35:22.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2772 0.33 MB/sec warmup 96 sec latency 354.121 ms 2024-01-27T14:35:23.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2872 0.33 MB/sec warmup 97 sec latency 299.630 ms 2024-01-27T14:35:24.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2898 0.33 MB/sec warmup 98 sec latency 306.530 ms 2024-01-27T14:35:25.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2932 0.34 MB/sec warmup 99 sec latency 198.071 ms 2024-01-27T14:35:26.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2968 0.34 MB/sec warmup 100 sec latency 309.284 ms 2024-01-27T14:35:27.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2984 0.33 MB/sec warmup 101 sec latency 323.884 ms 2024-01-27T14:35:28.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:35:28.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:35:28.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3007 0.33 MB/sec warmup 102 sec latency 300.488 ms 2024-01-27T14:35:29.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3024 0.33 MB/sec warmup 103 sec latency 288.697 ms 2024-01-27T14:35:30.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3171 0.33 MB/sec warmup 104 sec latency 311.797 ms 2024-01-27T14:35:31.525 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3197 0.33 MB/sec warmup 105 sec latency 319.348 ms 2024-01-27T14:35:32.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3266 0.33 MB/sec warmup 106 sec latency 207.309 ms 2024-01-27T14:35:33.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3280 0.33 MB/sec warmup 107 sec latency 302.000 ms 2024-01-27T14:35:34.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3285 0.33 MB/sec warmup 108 sec latency 317.945 ms 2024-01-27T14:35:35.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3290 0.32 MB/sec warmup 109 sec latency 329.511 ms 2024-01-27T14:35:36.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3293 0.32 MB/sec warmup 110 sec latency 405.927 ms 2024-01-27T14:35:37.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3297 0.32 MB/sec warmup 111 sec latency 396.085 ms 2024-01-27T14:35:38.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3303 0.32 MB/sec warmup 112 sec latency 330.345 ms 2024-01-27T14:35:39.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3308 0.31 MB/sec warmup 113 sec latency 519.754 ms 2024-01-27T14:35:40.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3311 0.31 MB/sec warmup 114 sec latency 312.163 ms 2024-01-27T14:35:41.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3314 0.31 MB/sec warmup 115 sec latency 318.123 ms 2024-01-27T14:35:42.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3319 0.30 MB/sec warmup 116 sec latency 315.262 ms 2024-01-27T14:35:43.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3323 0.30 MB/sec warmup 117 sec latency 301.111 ms 2024-01-27T14:35:44.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3326 0.30 MB/sec warmup 118 sec latency 309.868 ms 2024-01-27T14:35:45.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3331 0.30 MB/sec warmup 119 sec latency 320.606 ms 2024-01-27T14:35:47.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3341 0.01 MB/sec execute 1 sec latency 322.100 ms 2024-01-27T14:35:48.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3366 0.04 MB/sec execute 2 sec latency 143.792 ms 2024-01-27T14:35:49.526 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3391 0.04 MB/sec execute 3 sec latency 203.168 ms 2024-01-27T14:35:50.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3398 0.03 MB/sec execute 4 sec latency 321.258 ms 2024-01-27T14:35:51.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3516 0.60 MB/sec execute 5 sec latency 312.061 ms 2024-01-27T14:35:52.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3548 0.51 MB/sec execute 6 sec latency 299.053 ms 2024-01-27T14:35:53.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3561 0.44 MB/sec execute 7 sec latency 304.403 ms 2024-01-27T14:35:54.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3587 0.38 MB/sec execute 8 sec latency 294.247 ms 2024-01-27T14:35:55.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3633 0.36 MB/sec execute 9 sec latency 347.722 ms 2024-01-27T14:35:56.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3663 0.33 MB/sec execute 10 sec latency 307.997 ms 2024-01-27T14:35:57.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3674 0.30 MB/sec execute 11 sec latency 313.835 ms 2024-01-27T14:35:58.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:35:58.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:35:58.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3695 0.28 MB/sec execute 12 sec latency 292.042 ms 2024-01-27T14:35:59.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3716 0.26 MB/sec execute 13 sec latency 253.183 ms 2024-01-27T14:36:00.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3768 0.31 MB/sec execute 14 sec latency 315.330 ms 2024-01-27T14:36:01.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3784 0.29 MB/sec execute 15 sec latency 281.541 ms 2024-01-27T14:36:02.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3792 0.27 MB/sec execute 16 sec latency 205.830 ms 2024-01-27T14:36:03.527 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3806 0.26 MB/sec execute 17 sec latency 201.139 ms 2024-01-27T14:36:04.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3822 0.24 MB/sec execute 18 sec latency 150.781 ms 2024-01-27T14:36:05.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3838 0.23 MB/sec execute 19 sec latency 187.584 ms 2024-01-27T14:36:06.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3853 0.22 MB/sec execute 20 sec latency 197.864 ms 2024-01-27T14:36:07.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3870 0.21 MB/sec execute 21 sec latency 171.279 ms 2024-01-27T14:36:08.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3879 0.20 MB/sec execute 22 sec latency 317.279 ms 2024-01-27T14:36:09.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3898 0.20 MB/sec execute 23 sec latency 317.976 ms 2024-01-27T14:36:10.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3915 0.20 MB/sec execute 24 sec latency 310.110 ms 2024-01-27T14:36:11.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3934 0.19 MB/sec execute 25 sec latency 184.867 ms 2024-01-27T14:36:12.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3943 0.18 MB/sec execute 26 sec latency 213.769 ms 2024-01-27T14:36:13.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3959 0.17 MB/sec execute 27 sec latency 179.977 ms 2024-01-27T14:36:14.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3975 0.17 MB/sec execute 28 sec latency 146.844 ms 2024-01-27T14:36:15.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3991 0.16 MB/sec execute 29 sec latency 172.922 ms 2024-01-27T14:36:16.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4008 0.16 MB/sec execute 30 sec latency 151.173 ms 2024-01-27T14:36:17.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4025 0.15 MB/sec execute 31 sec latency 157.711 ms 2024-01-27T14:36:18.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4032 0.15 MB/sec execute 32 sec latency 331.633 ms 2024-01-27T14:36:19.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4046 0.14 MB/sec execute 33 sec latency 334.890 ms 2024-01-27T14:36:20.528 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4062 0.14 MB/sec execute 34 sec latency 298.163 ms 2024-01-27T14:36:21.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4082 0.13 MB/sec execute 35 sec latency 317.772 ms 2024-01-27T14:36:22.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4110 0.13 MB/sec execute 36 sec latency 287.293 ms 2024-01-27T14:36:23.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4130 0.13 MB/sec execute 37 sec latency 216.128 ms 2024-01-27T14:36:24.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4153 0.12 MB/sec execute 38 sec latency 263.182 ms 2024-01-27T14:36:25.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4172 0.12 MB/sec execute 39 sec latency 304.538 ms 2024-01-27T14:36:26.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4181 0.12 MB/sec execute 40 sec latency 300.927 ms 2024-01-27T14:36:27.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4217 0.12 MB/sec execute 41 sec latency 347.477 ms 2024-01-27T14:36:28.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:36:28.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:36:28.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4226 0.11 MB/sec execute 42 sec latency 352.190 ms 2024-01-27T14:36:29.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4254 0.11 MB/sec execute 43 sec latency 304.641 ms 2024-01-27T14:36:30.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4283 0.11 MB/sec execute 44 sec latency 290.323 ms 2024-01-27T14:36:31.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4317 0.11 MB/sec execute 45 sec latency 326.000 ms 2024-01-27T14:36:32.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4350 0.11 MB/sec execute 46 sec latency 314.064 ms 2024-01-27T14:36:33.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4384 0.11 MB/sec execute 47 sec latency 347.502 ms 2024-01-27T14:36:34.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4393 0.11 MB/sec execute 48 sec latency 352.991 ms 2024-01-27T14:36:35.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4431 0.11 MB/sec execute 49 sec latency 323.573 ms 2024-01-27T14:36:36.529 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4450 0.11 MB/sec execute 50 sec latency 364.025 ms 2024-01-27T14:36:37.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4474 0.11 MB/sec execute 51 sec latency 286.323 ms 2024-01-27T14:36:38.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4499 0.11 MB/sec execute 52 sec latency 326.339 ms 2024-01-27T14:36:39.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4506 0.10 MB/sec execute 53 sec latency 298.794 ms 2024-01-27T14:36:40.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4538 0.10 MB/sec execute 54 sec latency 309.887 ms 2024-01-27T14:36:41.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4564 0.10 MB/sec execute 55 sec latency 311.844 ms 2024-01-27T14:36:42.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4602 0.12 MB/sec execute 56 sec latency 300.035 ms 2024-01-27T14:36:43.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4616 0.12 MB/sec execute 57 sec latency 309.740 ms 2024-01-27T14:36:44.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4632 0.11 MB/sec execute 58 sec latency 311.513 ms 2024-01-27T14:36:45.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4668 0.11 MB/sec execute 59 sec latency 308.141 ms 2024-01-27T14:36:46.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4694 0.11 MB/sec execute 60 sec latency 317.970 ms 2024-01-27T14:36:47.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4724 0.11 MB/sec execute 61 sec latency 202.650 ms 2024-01-27T14:36:48.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4736 0.11 MB/sec execute 62 sec latency 317.202 ms 2024-01-27T14:36:49.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4747 0.11 MB/sec execute 63 sec latency 391.837 ms 2024-01-27T14:36:50.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4780 0.11 MB/sec execute 64 sec latency 303.014 ms 2024-01-27T14:36:51.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4814 0.11 MB/sec execute 65 sec latency 240.027 ms 2024-01-27T14:36:52.530 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4844 0.10 MB/sec execute 66 sec latency 359.956 ms 2024-01-27T14:36:53.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4850 0.10 MB/sec execute 67 sec latency 328.222 ms 2024-01-27T14:36:54.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4943 0.14 MB/sec execute 68 sec latency 427.930 ms 2024-01-27T14:36:55.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4953 0.14 MB/sec execute 69 sec latency 301.253 ms 2024-01-27T14:36:56.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4983 0.14 MB/sec execute 70 sec latency 291.304 ms 2024-01-27T14:36:57.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5011 0.14 MB/sec execute 71 sec latency 344.083 ms 2024-01-27T14:36:58.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:36:58.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:36:58.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5031 0.14 MB/sec execute 72 sec latency 397.804 ms 2024-01-27T14:36:59.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5051 0.13 MB/sec execute 73 sec latency 463.923 ms 2024-01-27T14:37:00.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5067 0.13 MB/sec execute 74 sec latency 308.588 ms 2024-01-27T14:37:01.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5092 0.13 MB/sec execute 75 sec latency 309.812 ms 2024-01-27T14:37:02.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5120 0.13 MB/sec execute 76 sec latency 325.812 ms 2024-01-27T14:37:03.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5151 0.13 MB/sec execute 77 sec latency 294.774 ms 2024-01-27T14:37:04.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5171 0.13 MB/sec execute 78 sec latency 303.012 ms 2024-01-27T14:37:05.531 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5182 0.13 MB/sec execute 79 sec latency 309.712 ms 2024-01-27T14:37:06.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5209 0.12 MB/sec execute 80 sec latency 307.763 ms 2024-01-27T14:37:07.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5251 0.12 MB/sec execute 81 sec latency 334.418 ms 2024-01-27T14:37:08.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5266 0.12 MB/sec execute 82 sec latency 260.398 ms 2024-01-27T14:37:09.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5333 0.12 MB/sec execute 83 sec latency 375.033 ms 2024-01-27T14:37:10.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5367 0.12 MB/sec execute 84 sec latency 303.513 ms 2024-01-27T14:37:11.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5387 0.12 MB/sec execute 85 sec latency 307.584 ms 2024-01-27T14:37:12.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5404 0.12 MB/sec execute 86 sec latency 326.184 ms 2024-01-27T14:37:13.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5424 0.12 MB/sec execute 87 sec latency 316.491 ms 2024-01-27T14:37:14.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5434 0.11 MB/sec execute 88 sec latency 322.880 ms 2024-01-27T14:37:15.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5468 0.11 MB/sec execute 89 sec latency 348.383 ms 2024-01-27T14:37:16.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5485 0.11 MB/sec execute 90 sec latency 332.083 ms 2024-01-27T14:37:17.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5540 0.11 MB/sec execute 91 sec latency 293.577 ms 2024-01-27T14:37:18.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5583 0.11 MB/sec execute 92 sec latency 311.923 ms 2024-01-27T14:37:19.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5605 0.11 MB/sec execute 93 sec latency 315.838 ms 2024-01-27T14:37:20.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5620 0.11 MB/sec execute 94 sec latency 306.589 ms 2024-01-27T14:37:21.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5643 0.11 MB/sec execute 95 sec latency 327.710 ms 2024-01-27T14:37:22.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5658 0.11 MB/sec execute 96 sec latency 319.707 ms 2024-01-27T14:37:23.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5702 0.11 MB/sec execute 97 sec latency 355.796 ms 2024-01-27T14:37:24.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5735 0.11 MB/sec execute 98 sec latency 356.709 ms 2024-01-27T14:37:25.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5743 0.11 MB/sec execute 99 sec latency 340.415 ms 2024-01-27T14:37:26.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5780 0.11 MB/sec execute 100 sec latency 324.585 ms 2024-01-27T14:37:27.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5853 0.11 MB/sec execute 101 sec latency 299.951 ms 2024-01-27T14:37:28.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:37:28.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:37:28.532 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5866 0.11 MB/sec execute 102 sec latency 298.664 ms 2024-01-27T14:37:29.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5881 0.11 MB/sec execute 103 sec latency 463.096 ms 2024-01-27T14:37:30.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5895 0.11 MB/sec execute 104 sec latency 291.644 ms 2024-01-27T14:37:31.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5918 0.11 MB/sec execute 105 sec latency 323.865 ms 2024-01-27T14:37:32.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5924 0.11 MB/sec execute 106 sec latency 571.108 ms 2024-01-27T14:37:33.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5931 0.11 MB/sec execute 107 sec latency 338.706 ms 2024-01-27T14:37:34.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5951 0.11 MB/sec execute 108 sec latency 337.254 ms 2024-01-27T14:37:35.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5970 0.11 MB/sec execute 109 sec latency 313.479 ms 2024-01-27T14:37:36.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5992 0.11 MB/sec execute 110 sec latency 314.001 ms 2024-01-27T14:37:37.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6007 0.11 MB/sec execute 111 sec latency 293.990 ms 2024-01-27T14:37:38.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6030 0.11 MB/sec execute 112 sec latency 222.823 ms 2024-01-27T14:37:39.533 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6054 0.11 MB/sec execute 113 sec latency 335.962 ms 2024-01-27T14:37:40.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6064 0.11 MB/sec execute 114 sec latency 310.118 ms 2024-01-27T14:37:41.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6117 0.11 MB/sec execute 115 sec latency 314.596 ms 2024-01-27T14:37:42.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6138 0.11 MB/sec execute 116 sec latency 306.742 ms 2024-01-27T14:37:43.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6152 0.11 MB/sec execute 117 sec latency 330.567 ms 2024-01-27T14:37:44.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6166 0.11 MB/sec execute 118 sec latency 307.566 ms 2024-01-27T14:37:45.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6176 0.11 MB/sec execute 119 sec latency 326.013 ms 2024-01-27T14:37:46.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6276 0.13 MB/sec execute 120 sec latency 308.444 ms 2024-01-27T14:37:47.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6316 0.13 MB/sec execute 121 sec latency 299.038 ms 2024-01-27T14:37:48.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6336 0.13 MB/sec execute 122 sec latency 332.623 ms 2024-01-27T14:37:49.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6431 0.13 MB/sec execute 123 sec latency 378.853 ms 2024-01-27T14:37:50.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6465 0.14 MB/sec execute 124 sec latency 143.967 ms 2024-01-27T14:37:51.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6493 0.14 MB/sec execute 125 sec latency 204.515 ms 2024-01-27T14:37:52.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6529 0.14 MB/sec execute 126 sec latency 311.710 ms 2024-01-27T14:37:53.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6548 0.14 MB/sec execute 127 sec latency 331.474 ms 2024-01-27T14:37:54.534 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6567 0.13 MB/sec execute 128 sec latency 312.130 ms 2024-01-27T14:37:55.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6586 0.13 MB/sec execute 129 sec latency 278.687 ms 2024-01-27T14:37:56.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6743 0.14 MB/sec execute 130 sec latency 306.991 ms 2024-01-27T14:37:57.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6767 0.14 MB/sec execute 131 sec latency 297.806 ms 2024-01-27T14:37:58.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6825 0.14 MB/sec execute 132 sec latency 318.188 ms 2024-01-27T14:37:58.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:37:58.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:37:59.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6836 0.14 MB/sec execute 133 sec latency 307.600 ms 2024-01-27T14:38:00.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6840 0.14 MB/sec execute 134 sec latency 324.970 ms 2024-01-27T14:38:01.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6845 0.14 MB/sec execute 135 sec latency 356.075 ms 2024-01-27T14:38:02.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6848 0.14 MB/sec execute 136 sec latency 381.122 ms 2024-01-27T14:38:03.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6854 0.14 MB/sec execute 137 sec latency 389.757 ms 2024-01-27T14:38:04.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6861 0.14 MB/sec execute 138 sec latency 387.380 ms 2024-01-27T14:38:05.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6864 0.14 MB/sec execute 139 sec latency 331.665 ms 2024-01-27T14:38:06.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6867 0.14 MB/sec execute 140 sec latency 350.884 ms 2024-01-27T14:38:07.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6871 0.14 MB/sec execute 141 sec latency 336.611 ms 2024-01-27T14:38:08.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6874 0.13 MB/sec execute 142 sec latency 338.320 ms 2024-01-27T14:38:09.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6878 0.13 MB/sec execute 143 sec latency 420.846 ms 2024-01-27T14:38:10.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6882 0.13 MB/sec execute 144 sec latency 306.193 ms 2024-01-27T14:38:11.535 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6887 0.13 MB/sec execute 145 sec latency 295.809 ms 2024-01-27T14:38:12.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6890 0.13 MB/sec execute 146 sec latency 322.300 ms 2024-01-27T14:38:13.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6898 0.13 MB/sec execute 147 sec latency 295.757 ms 2024-01-27T14:38:14.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6927 0.13 MB/sec execute 148 sec latency 142.458 ms 2024-01-27T14:38:15.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6948 0.13 MB/sec execute 149 sec latency 340.551 ms 2024-01-27T14:38:16.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7046 0.15 MB/sec execute 150 sec latency 316.505 ms 2024-01-27T14:38:17.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7082 0.15 MB/sec execute 151 sec latency 136.241 ms 2024-01-27T14:38:18.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7107 0.15 MB/sec execute 152 sec latency 294.116 ms 2024-01-27T14:38:19.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7123 0.14 MB/sec execute 153 sec latency 407.759 ms 2024-01-27T14:38:20.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7162 0.15 MB/sec execute 154 sec latency 408.888 ms 2024-01-27T14:38:21.536 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7188 0.14 MB/sec execute 155 sec latency 151.380 ms 2024-01-27T14:38:22.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7212 0.14 MB/sec execute 156 sec latency 318.682 ms 2024-01-27T14:38:23.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7230 0.14 MB/sec execute 157 sec latency 318.786 ms 2024-01-27T14:38:24.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7248 0.14 MB/sec execute 158 sec latency 295.283 ms 2024-01-27T14:38:25.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7302 0.15 MB/sec execute 159 sec latency 118.645 ms 2024-01-27T14:38:26.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7319 0.15 MB/sec execute 160 sec latency 289.846 ms 2024-01-27T14:38:27.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7334 0.15 MB/sec execute 161 sec latency 190.999 ms 2024-01-27T14:38:28.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7344 0.15 MB/sec execute 162 sec latency 232.212 ms 2024-01-27T14:38:28.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:38:28.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:38:29.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7358 0.14 MB/sec execute 163 sec latency 226.729 ms 2024-01-27T14:38:30.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7375 0.14 MB/sec execute 164 sec latency 172.310 ms 2024-01-27T14:38:31.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7391 0.14 MB/sec execute 165 sec latency 164.838 ms 2024-01-27T14:38:32.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7407 0.14 MB/sec execute 166 sec latency 158.564 ms 2024-01-27T14:38:33.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7420 0.14 MB/sec execute 167 sec latency 312.498 ms 2024-01-27T14:38:34.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7440 0.14 MB/sec execute 168 sec latency 366.090 ms 2024-01-27T14:38:35.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7457 0.14 MB/sec execute 169 sec latency 320.723 ms 2024-01-27T14:38:36.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7472 0.14 MB/sec execute 170 sec latency 301.963 ms 2024-01-27T14:38:37.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7483 0.14 MB/sec execute 171 sec latency 184.438 ms 2024-01-27T14:38:38.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7496 0.14 MB/sec execute 172 sec latency 209.349 ms 2024-01-27T14:38:39.537 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7511 0.14 MB/sec execute 173 sec latency 162.897 ms 2024-01-27T14:38:40.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7527 0.14 MB/sec execute 174 sec latency 156.672 ms 2024-01-27T14:38:41.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7545 0.14 MB/sec execute 175 sec latency 180.046 ms 2024-01-27T14:38:42.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7562 0.14 MB/sec execute 176 sec latency 152.660 ms 2024-01-27T14:38:43.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7573 0.13 MB/sec execute 177 sec latency 324.448 ms 2024-01-27T14:38:44.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7583 0.13 MB/sec execute 178 sec latency 338.059 ms 2024-01-27T14:38:45.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7602 0.13 MB/sec execute 179 sec latency 299.013 ms 2024-01-27T14:38:46.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7615 0.13 MB/sec execute 180 sec latency 307.654 ms 2024-01-27T14:38:47.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7639 0.13 MB/sec execute 181 sec latency 302.555 ms 2024-01-27T14:38:48.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7659 0.13 MB/sec execute 182 sec latency 245.210 ms 2024-01-27T14:38:49.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7685 0.13 MB/sec execute 183 sec latency 209.301 ms 2024-01-27T14:38:50.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7704 0.13 MB/sec execute 184 sec latency 302.596 ms 2024-01-27T14:38:51.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7718 0.13 MB/sec execute 185 sec latency 292.277 ms 2024-01-27T14:38:52.538 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7728 0.13 MB/sec execute 186 sec latency 362.884 ms 2024-01-27T14:38:53.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7766 0.13 MB/sec execute 187 sec latency 371.882 ms 2024-01-27T14:38:54.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7794 0.13 MB/sec execute 188 sec latency 386.997 ms 2024-01-27T14:38:55.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7823 0.13 MB/sec execute 189 sec latency 299.853 ms 2024-01-27T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7857 0.13 MB/sec execute 190 sec latency 210.745 ms 2024-01-27T14:38:57.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7891 0.13 MB/sec execute 191 sec latency 298.884 ms 2024-01-27T14:38:58.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7925 0.13 MB/sec execute 192 sec latency 215.670 ms 2024-01-27T14:38:58.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:38:58.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:38:59.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7930 0.13 MB/sec execute 193 sec latency 496.313 ms 2024-01-27T14:39:00.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7966 0.13 MB/sec execute 194 sec latency 321.136 ms 2024-01-27T14:39:01.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7975 0.13 MB/sec execute 195 sec latency 359.610 ms 2024-01-27T14:39:02.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8009 0.13 MB/sec execute 196 sec latency 308.247 ms 2024-01-27T14:39:03.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8039 0.13 MB/sec execute 197 sec latency 238.303 ms 2024-01-27T14:39:04.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8043 0.12 MB/sec execute 198 sec latency 332.803 ms 2024-01-27T14:39:05.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8053 0.12 MB/sec execute 199 sec latency 311.179 ms 2024-01-27T14:39:06.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8101 0.12 MB/sec execute 200 sec latency 325.701 ms 2024-01-27T14:39:07.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8138 0.13 MB/sec execute 201 sec latency 308.607 ms 2024-01-27T14:39:08.539 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8156 0.13 MB/sec execute 202 sec latency 318.573 ms 2024-01-27T14:39:09.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8169 0.13 MB/sec execute 203 sec latency 419.294 ms 2024-01-27T14:39:10.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8198 0.13 MB/sec execute 204 sec latency 203.706 ms 2024-01-27T14:39:11.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8223 0.13 MB/sec execute 205 sec latency 297.321 ms 2024-01-27T14:39:12.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8256 0.13 MB/sec execute 206 sec latency 312.729 ms 2024-01-27T14:39:13.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8276 0.13 MB/sec execute 207 sec latency 290.480 ms 2024-01-27T14:39:14.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8285 0.12 MB/sec execute 208 sec latency 318.747 ms 2024-01-27T14:39:15.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8312 0.12 MB/sec execute 209 sec latency 234.506 ms 2024-01-27T14:39:16.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8352 0.12 MB/sec execute 210 sec latency 318.720 ms 2024-01-27T14:39:17.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8381 0.12 MB/sec execute 211 sec latency 304.429 ms 2024-01-27T14:39:18.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8390 0.12 MB/sec execute 212 sec latency 345.463 ms 2024-01-27T14:39:19.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8485 0.14 MB/sec execute 213 sec latency 538.828 ms 2024-01-27T14:39:20.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8494 0.13 MB/sec execute 214 sec latency 319.590 ms 2024-01-27T14:39:21.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8506 0.13 MB/sec execute 215 sec latency 309.658 ms 2024-01-27T14:39:22.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8537 0.13 MB/sec execute 216 sec latency 314.814 ms 2024-01-27T14:39:23.540 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8564 0.13 MB/sec execute 217 sec latency 320.932 ms 2024-01-27T14:39:24.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8594 0.13 MB/sec execute 218 sec latency 315.441 ms 2024-01-27T14:39:25.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8608 0.13 MB/sec execute 219 sec latency 342.955 ms 2024-01-27T14:39:26.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8635 0.13 MB/sec execute 220 sec latency 172.145 ms 2024-01-27T14:39:27.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8662 0.13 MB/sec execute 221 sec latency 298.573 ms 2024-01-27T14:39:28.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8690 0.13 MB/sec execute 222 sec latency 313.785 ms 2024-01-27T14:39:28.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:39:28.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:39:29.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8711 0.13 MB/sec execute 223 sec latency 310.329 ms 2024-01-27T14:39:30.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8724 0.13 MB/sec execute 224 sec latency 304.399 ms 2024-01-27T14:39:31.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8751 0.13 MB/sec execute 225 sec latency 313.970 ms 2024-01-27T14:39:32.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8781 0.13 MB/sec execute 226 sec latency 345.937 ms 2024-01-27T14:39:33.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8807 0.13 MB/sec execute 227 sec latency 385.485 ms 2024-01-27T14:39:34.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8844 0.13 MB/sec execute 228 sec latency 319.833 ms 2024-01-27T14:39:35.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8891 0.13 MB/sec execute 229 sec latency 284.836 ms 2024-01-27T14:39:36.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8928 0.13 MB/sec execute 230 sec latency 339.099 ms 2024-01-27T14:39:37.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8940 0.13 MB/sec execute 231 sec latency 311.009 ms 2024-01-27T14:39:38.541 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8967 0.13 MB/sec execute 232 sec latency 297.148 ms 2024-01-27T14:39:39.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8977 0.13 MB/sec execute 233 sec latency 301.528 ms 2024-01-27T14:39:40.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9011 0.13 MB/sec execute 234 sec latency 352.645 ms 2024-01-27T14:39:41.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9029 0.12 MB/sec execute 235 sec latency 297.026 ms 2024-01-27T14:39:42.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9082 0.12 MB/sec execute 236 sec latency 302.090 ms 2024-01-27T14:39:43.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9107 0.12 MB/sec execute 237 sec latency 304.764 ms 2024-01-27T14:39:44.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9149 0.12 MB/sec execute 238 sec latency 331.350 ms 2024-01-27T14:39:45.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9162 0.12 MB/sec execute 239 sec latency 305.188 ms 2024-01-27T14:39:46.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9185 0.12 MB/sec execute 240 sec latency 323.575 ms 2024-01-27T14:39:47.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9199 0.12 MB/sec execute 241 sec latency 314.487 ms 2024-01-27T14:39:48.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9246 0.12 MB/sec execute 242 sec latency 347.173 ms 2024-01-27T14:39:49.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9279 0.12 MB/sec execute 243 sec latency 331.646 ms 2024-01-27T14:39:50.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9287 0.12 MB/sec execute 244 sec latency 325.489 ms 2024-01-27T14:39:51.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9310 0.12 MB/sec execute 245 sec latency 324.415 ms 2024-01-27T14:39:52.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9378 0.12 MB/sec execute 246 sec latency 294.060 ms 2024-01-27T14:39:53.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9407 0.12 MB/sec execute 247 sec latency 295.388 ms 2024-01-27T14:39:54.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9425 0.12 MB/sec execute 248 sec latency 416.209 ms 2024-01-27T14:39:55.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9439 0.12 MB/sec execute 249 sec latency 295.466 ms 2024-01-27T14:39:56.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9462 0.12 MB/sec execute 250 sec latency 310.907 ms 2024-01-27T14:39:57.438 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:55.897 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.499 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:55.958 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.514 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:08:55.923 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.542 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9468 0.12 MB/sec execute 251 sec latency 317.303 ms 2024-01-27T14:39:57.568 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:08:55.977 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.576 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:08:55.985 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.636 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:08:56.044 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.901 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:56.360 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:57.957 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:08:56.366 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:58.025 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:08:56.434 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:39:58.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9471 0.12 MB/sec execute 252 sec latency 557.670 ms 2024-01-27T14:39:59.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:39:59.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:39:59.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9492 0.12 MB/sec execute 253 sec latency 403.434 ms 2024-01-27T14:40:00.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9505 0.12 MB/sec execute 254 sec latency 301.125 ms 2024-01-27T14:40:01.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9532 0.12 MB/sec execute 255 sec latency 361.402 ms 2024-01-27T14:40:02.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9540 0.12 MB/sec execute 256 sec latency 326.197 ms 2024-01-27T14:40:03.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9570 0.12 MB/sec execute 257 sec latency 154.096 ms 2024-01-27T14:40:04.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9594 0.12 MB/sec execute 258 sec latency 333.964 ms 2024-01-27T14:40:05.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9606 0.12 MB/sec execute 259 sec latency 302.764 ms 2024-01-27T14:40:06.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9655 0.12 MB/sec execute 260 sec latency 311.115 ms 2024-01-27T14:40:07.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9673 0.12 MB/sec execute 261 sec latency 306.031 ms 2024-01-27T14:40:08.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9684 0.12 MB/sec execute 262 sec latency 332.984 ms 2024-01-27T14:40:09.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9702 0.12 MB/sec execute 263 sec latency 357.579 ms 2024-01-27T14:40:10.543 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9719 0.12 MB/sec execute 264 sec latency 333.728 ms 2024-01-27T14:40:11.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9735 0.12 MB/sec execute 265 sec latency 316.520 ms 2024-01-27T14:40:12.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9850 0.13 MB/sec execute 266 sec latency 327.624 ms 2024-01-27T14:40:13.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9870 0.13 MB/sec execute 267 sec latency 336.638 ms 2024-01-27T14:40:14.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9971 0.13 MB/sec execute 268 sec latency 307.742 ms 2024-01-27T14:40:15.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9999 0.13 MB/sec execute 269 sec latency 272.857 ms 2024-01-27T14:40:16.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10033 0.13 MB/sec execute 270 sec latency 194.502 ms 2024-01-27T14:40:17.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10068 0.13 MB/sec execute 271 sec latency 299.323 ms 2024-01-27T14:40:18.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10083 0.13 MB/sec execute 272 sec latency 380.482 ms 2024-01-27T14:40:19.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10096 0.13 MB/sec execute 273 sec latency 321.643 ms 2024-01-27T14:40:20.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10123 0.13 MB/sec execute 274 sec latency 223.802 ms 2024-01-27T14:40:21.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10269 0.13 MB/sec execute 275 sec latency 399.701 ms 2024-01-27T14:40:22.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10289 0.13 MB/sec execute 276 sec latency 325.626 ms 2024-01-27T14:40:23.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10365 0.14 MB/sec execute 277 sec latency 200.436 ms 2024-01-27T14:40:24.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10379 0.14 MB/sec execute 278 sec latency 340.463 ms 2024-01-27T14:40:25.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10384 0.14 MB/sec execute 279 sec latency 319.198 ms 2024-01-27T14:40:26.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10386 0.14 MB/sec execute 280 sec latency 357.970 ms 2024-01-27T14:40:27.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10391 0.14 MB/sec execute 281 sec latency 382.709 ms 2024-01-27T14:40:28.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10394 0.14 MB/sec execute 282 sec latency 321.046 ms 2024-01-27T14:40:29.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:40:29.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:40:29.385 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:27.844 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.395 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:27.854 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.403 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:27.812 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.404 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:27.813 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.406 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:27.815 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.408 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:27.817 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.443 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:27.902 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.470 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:09:27.878 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.470 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:09:27.878 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:40:29.544 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10400 0.14 MB/sec execute 283 sec latency 475.852 ms 2024-01-27T14:40:30.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10406 0.13 MB/sec execute 284 sec latency 323.513 ms 2024-01-27T14:40:31.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10409 0.13 MB/sec execute 285 sec latency 301.366 ms 2024-01-27T14:40:32.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10413 0.13 MB/sec execute 286 sec latency 305.856 ms 2024-01-27T14:40:33.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10417 0.13 MB/sec execute 287 sec latency 324.913 ms 2024-01-27T14:40:34.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10421 0.13 MB/sec execute 288 sec latency 331.196 ms 2024-01-27T14:40:35.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10425 0.13 MB/sec execute 289 sec latency 299.947 ms 2024-01-27T14:40:36.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10430 0.13 MB/sec execute 290 sec latency 306.780 ms 2024-01-27T14:40:37.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10433 0.13 MB/sec execute 291 sec latency 317.109 ms 2024-01-27T14:40:38.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10436 0.13 MB/sec execute 292 sec latency 317.076 ms 2024-01-27T14:40:39.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10460 0.13 MB/sec execute 293 sec latency 297.740 ms 2024-01-27T14:40:40.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10489 0.13 MB/sec execute 294 sec latency 152.811 ms 2024-01-27T14:40:41.545 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10496 0.13 MB/sec execute 295 sec latency 311.690 ms 2024-01-27T14:40:42.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10611 0.14 MB/sec execute 296 sec latency 313.286 ms 2024-01-27T14:40:43.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10636 0.14 MB/sec execute 297 sec latency 310.611 ms 2024-01-27T14:40:44.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10654 0.14 MB/sec execute 298 sec latency 341.523 ms 2024-01-27T14:40:45.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10677 0.14 MB/sec execute 299 sec latency 342.546 ms 2024-01-27T14:40:46.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10720 0.14 MB/sec execute 300 sec latency 308.670 ms 2024-01-27T14:40:47.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10741 0.14 MB/sec execute 301 sec latency 318.090 ms 2024-01-27T14:40:48.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10764 0.14 MB/sec execute 302 sec latency 407.386 ms 2024-01-27T14:40:49.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10779 0.14 MB/sec execute 303 sec latency 364.120 ms 2024-01-27T14:40:50.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10806 0.14 MB/sec execute 304 sec latency 152.353 ms 2024-01-27T14:40:51.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10856 0.14 MB/sec execute 305 sec latency 313.745 ms 2024-01-27T14:40:52.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10871 0.14 MB/sec execute 306 sec latency 181.239 ms 2024-01-27T14:40:53.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10882 0.14 MB/sec execute 307 sec latency 216.443 ms 2024-01-27T14:40:54.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10895 0.14 MB/sec execute 308 sec latency 222.575 ms 2024-01-27T14:40:55.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10910 0.14 MB/sec execute 309 sec latency 147.694 ms 2024-01-27T14:40:56.546 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10927 0.14 MB/sec execute 310 sec latency 167.709 ms 2024-01-27T14:40:57.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10942 0.14 MB/sec execute 311 sec latency 187.454 ms 2024-01-27T14:40:58.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10959 0.14 MB/sec execute 312 sec latency 186.496 ms 2024-01-27T14:40:59.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:40:59.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:40:59.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10968 0.14 MB/sec execute 313 sec latency 343.713 ms 2024-01-27T14:41:00.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10988 0.14 MB/sec execute 314 sec latency 326.615 ms 2024-01-27T14:41:01.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11007 0.14 MB/sec execute 315 sec latency 304.694 ms 2024-01-27T14:41:02.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11025 0.14 MB/sec execute 316 sec latency 182.410 ms 2024-01-27T14:41:03.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11033 0.14 MB/sec execute 317 sec latency 189.622 ms 2024-01-27T14:41:04.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11049 0.13 MB/sec execute 318 sec latency 209.364 ms 2024-01-27T14:41:05.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11065 0.13 MB/sec execute 319 sec latency 153.170 ms 2024-01-27T14:41:06.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11081 0.13 MB/sec execute 320 sec latency 148.570 ms 2024-01-27T14:41:07.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11097 0.13 MB/sec execute 321 sec latency 166.669 ms 2024-01-27T14:41:08.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11113 0.13 MB/sec execute 322 sec latency 167.118 ms 2024-01-27T14:41:09.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11122 0.13 MB/sec execute 323 sec latency 419.722 ms 2024-01-27T14:41:10.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11134 0.13 MB/sec execute 324 sec latency 359.903 ms 2024-01-27T14:41:11.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11151 0.13 MB/sec execute 325 sec latency 295.277 ms 2024-01-27T14:41:12.547 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11172 0.13 MB/sec execute 326 sec latency 305.787 ms 2024-01-27T14:41:13.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11197 0.13 MB/sec execute 327 sec latency 305.237 ms 2024-01-27T14:41:14.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11217 0.13 MB/sec execute 328 sec latency 212.980 ms 2024-01-27T14:41:15.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11242 0.13 MB/sec execute 329 sec latency 138.044 ms 2024-01-27T14:41:16.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11260 0.13 MB/sec execute 330 sec latency 391.136 ms 2024-01-27T14:41:17.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11269 0.13 MB/sec execute 331 sec latency 323.505 ms 2024-01-27T14:41:18.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11305 0.13 MB/sec execute 332 sec latency 369.387 ms 2024-01-27T14:41:19.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11314 0.13 MB/sec execute 333 sec latency 470.038 ms 2024-01-27T14:41:20.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11342 0.13 MB/sec execute 334 sec latency 330.511 ms 2024-01-27T14:41:21.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11371 0.13 MB/sec execute 335 sec latency 292.768 ms 2024-01-27T14:41:22.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11406 0.13 MB/sec execute 336 sec latency 318.796 ms 2024-01-27T14:41:23.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11439 0.13 MB/sec execute 337 sec latency 319.136 ms 2024-01-27T14:41:24.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11473 0.13 MB/sec execute 338 sec latency 323.689 ms 2024-01-27T14:41:25.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11482 0.13 MB/sec execute 339 sec latency 335.796 ms 2024-01-27T14:41:26.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11516 0.13 MB/sec execute 340 sec latency 358.910 ms 2024-01-27T14:41:27.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11539 0.13 MB/sec execute 341 sec latency 312.358 ms 2024-01-27T14:41:28.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11563 0.13 MB/sec execute 342 sec latency 303.218 ms 2024-01-27T14:41:29.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:41:29.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:41:29.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11587 0.13 MB/sec execute 343 sec latency 433.679 ms 2024-01-27T14:41:30.548 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11595 0.13 MB/sec execute 344 sec latency 314.864 ms 2024-01-27T14:41:31.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11627 0.13 MB/sec execute 345 sec latency 307.366 ms 2024-01-27T14:41:32.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11656 0.13 MB/sec execute 346 sec latency 318.669 ms 2024-01-27T14:41:33.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11691 0.13 MB/sec execute 347 sec latency 303.011 ms 2024-01-27T14:41:34.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11704 0.13 MB/sec execute 348 sec latency 314.412 ms 2024-01-27T14:41:35.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11721 0.13 MB/sec execute 349 sec latency 291.655 ms 2024-01-27T14:41:36.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11757 0.13 MB/sec execute 350 sec latency 308.421 ms 2024-01-27T14:41:37.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11784 0.13 MB/sec execute 351 sec latency 305.405 ms 2024-01-27T14:41:38.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11814 0.13 MB/sec execute 352 sec latency 264.609 ms 2024-01-27T14:41:39.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11826 0.13 MB/sec execute 353 sec latency 351.799 ms 2024-01-27T14:41:40.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11854 0.13 MB/sec execute 354 sec latency 289.173 ms 2024-01-27T14:41:41.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11881 0.13 MB/sec execute 355 sec latency 313.064 ms 2024-01-27T14:41:42.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11904 0.13 MB/sec execute 356 sec latency 332.740 ms 2024-01-27T14:41:43.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11934 0.13 MB/sec execute 357 sec latency 365.737 ms 2024-01-27T14:41:44.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11940 0.13 MB/sec execute 358 sec latency 442.239 ms 2024-01-27T14:41:45.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12034 0.13 MB/sec execute 359 sec latency 310.964 ms 2024-01-27T14:41:46.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12049 0.13 MB/sec execute 360 sec latency 313.911 ms 2024-01-27T14:41:47.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12073 0.13 MB/sec execute 361 sec latency 303.087 ms 2024-01-27T14:41:48.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12102 0.13 MB/sec execute 362 sec latency 364.496 ms 2024-01-27T14:41:49.549 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12121 0.13 MB/sec execute 363 sec latency 418.365 ms 2024-01-27T14:41:50.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12142 0.13 MB/sec execute 364 sec latency 328.555 ms 2024-01-27T14:41:51.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12158 0.13 MB/sec execute 365 sec latency 327.633 ms 2024-01-27T14:41:52.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12186 0.13 MB/sec execute 366 sec latency 294.997 ms 2024-01-27T14:41:53.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12211 0.13 MB/sec execute 367 sec latency 300.885 ms 2024-01-27T14:41:54.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12243 0.13 MB/sec execute 368 sec latency 75.430 ms 2024-01-27T14:41:55.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12264 0.13 MB/sec execute 369 sec latency 306.764 ms 2024-01-27T14:41:56.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12280 0.13 MB/sec execute 370 sec latency 329.037 ms 2024-01-27T14:41:57.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12299 0.13 MB/sec execute 371 sec latency 305.666 ms 2024-01-27T14:41:58.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12344 0.13 MB/sec execute 372 sec latency 318.682 ms 2024-01-27T14:41:59.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:41:59.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:41:59.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12357 0.13 MB/sec execute 373 sec latency 337.633 ms 2024-01-27T14:42:00.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12425 0.13 MB/sec execute 374 sec latency 293.109 ms 2024-01-27T14:42:01.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12460 0.13 MB/sec execute 375 sec latency 292.358 ms 2024-01-27T14:42:02.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12478 0.13 MB/sec execute 376 sec latency 308.448 ms 2024-01-27T14:42:03.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12496 0.13 MB/sec execute 377 sec latency 331.473 ms 2024-01-27T14:42:04.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12518 0.13 MB/sec execute 378 sec latency 314.241 ms 2024-01-27T14:42:05.550 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12529 0.13 MB/sec execute 379 sec latency 339.764 ms 2024-01-27T14:42:06.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12561 0.13 MB/sec execute 380 sec latency 319.825 ms 2024-01-27T14:42:07.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12578 0.13 MB/sec execute 381 sec latency 324.140 ms 2024-01-27T14:42:08.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12633 0.13 MB/sec execute 382 sec latency 325.909 ms 2024-01-27T14:42:09.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12672 0.13 MB/sec execute 383 sec latency 338.328 ms 2024-01-27T14:42:10.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12698 0.13 MB/sec execute 384 sec latency 323.261 ms 2024-01-27T14:42:11.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12714 0.13 MB/sec execute 385 sec latency 307.530 ms 2024-01-27T14:42:12.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12736 0.13 MB/sec execute 386 sec latency 333.891 ms 2024-01-27T14:42:13.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12751 0.13 MB/sec execute 387 sec latency 316.743 ms 2024-01-27T14:42:14.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12795 0.13 MB/sec execute 388 sec latency 363.729 ms 2024-01-27T14:42:15.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12828 0.13 MB/sec execute 389 sec latency 335.225 ms 2024-01-27T14:42:16.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12837 0.12 MB/sec execute 390 sec latency 316.713 ms 2024-01-27T14:42:17.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12875 0.12 MB/sec execute 391 sec latency 328.414 ms 2024-01-27T14:42:18.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12947 0.13 MB/sec execute 392 sec latency 286.458 ms 2024-01-27T14:42:19.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12960 0.13 MB/sec execute 393 sec latency 378.882 ms 2024-01-27T14:42:20.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12978 0.13 MB/sec execute 394 sec latency 440.004 ms 2024-01-27T14:42:21.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12989 0.13 MB/sec execute 395 sec latency 305.593 ms 2024-01-27T14:42:22.551 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13015 0.13 MB/sec execute 396 sec latency 316.633 ms 2024-01-27T14:42:23.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13020 0.13 MB/sec execute 397 sec latency 325.295 ms 2024-01-27T14:42:24.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13030 0.13 MB/sec execute 398 sec latency 320.344 ms 2024-01-27T14:42:25.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13050 0.13 MB/sec execute 399 sec latency 341.722 ms 2024-01-27T14:42:26.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13076 0.13 MB/sec execute 400 sec latency 330.725 ms 2024-01-27T14:42:27.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13086 0.12 MB/sec execute 401 sec latency 323.030 ms 2024-01-27T14:42:28.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13107 0.12 MB/sec execute 402 sec latency 325.522 ms 2024-01-27T14:42:29.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13139 0.13 MB/sec execute 403 sec latency 361.086 ms 2024-01-27T14:42:29.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:42:29.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:42:30.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13150 0.13 MB/sec execute 404 sec latency 336.106 ms 2024-01-27T14:42:31.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13203 0.13 MB/sec execute 405 sec latency 310.399 ms 2024-01-27T14:42:32.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13213 0.13 MB/sec execute 406 sec latency 308.511 ms 2024-01-27T14:42:33.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13233 0.13 MB/sec execute 407 sec latency 327.476 ms 2024-01-27T14:42:34.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13252 0.12 MB/sec execute 408 sec latency 342.178 ms 2024-01-27T14:42:35.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13267 0.12 MB/sec execute 409 sec latency 297.464 ms 2024-01-27T14:42:36.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13273 0.12 MB/sec execute 410 sec latency 319.182 ms 2024-01-27T14:42:37.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13397 0.13 MB/sec execute 411 sec latency 310.136 ms 2024-01-27T14:42:38.552 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13415 0.13 MB/sec execute 412 sec latency 316.650 ms 2024-01-27T14:42:39.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13434 0.13 MB/sec execute 413 sec latency 356.637 ms 2024-01-27T14:42:40.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13546 0.13 MB/sec execute 414 sec latency 293.769 ms 2024-01-27T14:42:41.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13579 0.13 MB/sec execute 415 sec latency 159.207 ms 2024-01-27T14:42:42.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13616 0.13 MB/sec execute 416 sec latency 300.827 ms 2024-01-27T14:42:43.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13627 0.13 MB/sec execute 417 sec latency 317.468 ms 2024-01-27T14:42:44.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13645 0.13 MB/sec execute 418 sec latency 303.112 ms 2024-01-27T14:42:45.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13672 0.13 MB/sec execute 419 sec latency 224.131 ms 2024-01-27T14:42:46.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13817 0.13 MB/sec execute 420 sec latency 359.264 ms 2024-01-27T14:42:47.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13839 0.13 MB/sec execute 421 sec latency 318.395 ms 2024-01-27T14:42:48.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13896 0.13 MB/sec execute 422 sec latency 219.305 ms 2024-01-27T14:42:49.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13924 0.14 MB/sec execute 423 sec latency 374.777 ms 2024-01-27T14:42:50.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13932 0.14 MB/sec execute 424 sec latency 330.406 ms 2024-01-27T14:42:51.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13936 0.13 MB/sec execute 425 sec latency 373.097 ms 2024-01-27T14:42:52.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13941 0.13 MB/sec execute 426 sec latency 322.467 ms 2024-01-27T14:42:53.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13944 0.13 MB/sec execute 427 sec latency 379.537 ms 2024-01-27T14:42:54.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13948 0.13 MB/sec execute 428 sec latency 415.211 ms 2024-01-27T14:42:55.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13956 0.13 MB/sec execute 429 sec latency 352.490 ms 2024-01-27T14:42:56.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13959 0.13 MB/sec execute 430 sec latency 324.748 ms 2024-01-27T14:42:57.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13963 0.13 MB/sec execute 431 sec latency 305.226 ms 2024-01-27T14:42:58.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13967 0.13 MB/sec execute 432 sec latency 314.315 ms 2024-01-27T14:42:59.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13971 0.13 MB/sec execute 433 sec latency 393.573 ms 2024-01-27T14:42:59.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:42:59.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:43:00.553 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13974 0.13 MB/sec execute 434 sec latency 310.528 ms 2024-01-27T14:43:01.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13979 0.13 MB/sec execute 435 sec latency 309.670 ms 2024-01-27T14:43:02.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13982 0.13 MB/sec execute 436 sec latency 309.971 ms 2024-01-27T14:43:03.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13986 0.13 MB/sec execute 437 sec latency 310.004 ms 2024-01-27T14:43:04.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14008 0.13 MB/sec execute 438 sec latency 297.350 ms 2024-01-27T14:43:05.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14028 0.13 MB/sec execute 439 sec latency 134.127 ms 2024-01-27T14:43:06.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14044 0.13 MB/sec execute 440 sec latency 315.194 ms 2024-01-27T14:43:07.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14157 0.14 MB/sec execute 441 sec latency 307.012 ms 2024-01-27T14:43:08.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14180 0.14 MB/sec execute 442 sec latency 306.846 ms 2024-01-27T14:43:09.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14204 0.14 MB/sec execute 443 sec latency 312.006 ms 2024-01-27T14:43:10.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14225 0.14 MB/sec execute 444 sec latency 321.432 ms 2024-01-27T14:43:11.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14269 0.14 MB/sec execute 445 sec latency 398.693 ms 2024-01-27T14:43:12.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14286 0.14 MB/sec execute 446 sec latency 324.703 ms 2024-01-27T14:43:13.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14313 0.14 MB/sec execute 447 sec latency 295.443 ms 2024-01-27T14:43:14.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14329 0.14 MB/sec execute 448 sec latency 321.756 ms 2024-01-27T14:43:15.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14355 0.14 MB/sec execute 449 sec latency 149.201 ms 2024-01-27T14:43:16.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14406 0.14 MB/sec execute 450 sec latency 311.483 ms 2024-01-27T14:43:17.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14419 0.14 MB/sec execute 451 sec latency 199.886 ms 2024-01-27T14:43:18.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14431 0.14 MB/sec execute 452 sec latency 211.682 ms 2024-01-27T14:43:19.554 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14444 0.14 MB/sec execute 453 sec latency 232.998 ms 2024-01-27T14:43:20.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14459 0.14 MB/sec execute 454 sec latency 138.877 ms 2024-01-27T14:43:21.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14476 0.14 MB/sec execute 455 sec latency 160.608 ms 2024-01-27T14:43:22.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14491 0.14 MB/sec execute 456 sec latency 162.948 ms 2024-01-27T14:43:23.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14508 0.14 MB/sec execute 457 sec latency 185.293 ms 2024-01-27T14:43:24.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14517 0.13 MB/sec execute 458 sec latency 437.645 ms 2024-01-27T14:43:25.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14537 0.14 MB/sec execute 459 sec latency 334.507 ms 2024-01-27T14:43:26.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14554 0.13 MB/sec execute 460 sec latency 291.720 ms 2024-01-27T14:43:27.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14571 0.13 MB/sec execute 461 sec latency 189.910 ms 2024-01-27T14:43:28.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14582 0.13 MB/sec execute 462 sec latency 198.920 ms 2024-01-27T14:43:29.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14598 0.13 MB/sec execute 463 sec latency 186.530 ms 2024-01-27T14:43:29.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:43:29.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:43:30.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14614 0.13 MB/sec execute 464 sec latency 155.811 ms 2024-01-27T14:43:31.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14630 0.13 MB/sec execute 465 sec latency 160.007 ms 2024-01-27T14:43:32.555 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14647 0.13 MB/sec execute 466 sec latency 152.691 ms 2024-01-27T14:43:33.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14665 0.13 MB/sec execute 467 sec latency 156.451 ms 2024-01-27T14:43:34.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14671 0.13 MB/sec execute 468 sec latency 321.259 ms 2024-01-27T14:43:35.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14683 0.13 MB/sec execute 469 sec latency 314.981 ms 2024-01-27T14:43:36.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14701 0.13 MB/sec execute 470 sec latency 318.201 ms 2024-01-27T14:43:37.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14721 0.13 MB/sec execute 471 sec latency 303.261 ms 2024-01-27T14:43:38.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14744 0.13 MB/sec execute 472 sec latency 308.241 ms 2024-01-27T14:43:39.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14765 0.13 MB/sec execute 473 sec latency 217.382 ms 2024-01-27T14:43:40.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14789 0.13 MB/sec execute 474 sec latency 205.980 ms 2024-01-27T14:43:41.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14808 0.13 MB/sec execute 475 sec latency 394.941 ms 2024-01-27T14:43:42.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14816 0.13 MB/sec execute 476 sec latency 329.342 ms 2024-01-27T14:43:43.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14852 0.13 MB/sec execute 477 sec latency 323.435 ms 2024-01-27T14:43:44.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14861 0.13 MB/sec execute 478 sec latency 304.746 ms 2024-01-27T14:43:45.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14888 0.13 MB/sec execute 479 sec latency 318.708 ms 2024-01-27T14:43:46.556 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14918 0.13 MB/sec execute 480 sec latency 309.385 ms 2024-01-27T14:43:47.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14953 0.13 MB/sec execute 481 sec latency 310.753 ms 2024-01-27T14:43:48.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14985 0.13 MB/sec execute 482 sec latency 306.631 ms 2024-01-27T14:43:49.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15019 0.13 MB/sec execute 483 sec latency 299.343 ms 2024-01-27T14:43:50.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15029 0.13 MB/sec execute 484 sec latency 338.673 ms 2024-01-27T14:43:51.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15062 0.13 MB/sec execute 485 sec latency 365.655 ms 2024-01-27T14:43:52.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15082 0.13 MB/sec execute 486 sec latency 322.592 ms 2024-01-27T14:43:53.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15109 0.13 MB/sec execute 487 sec latency 278.436 ms 2024-01-27T14:43:54.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15134 0.13 MB/sec execute 488 sec latency 459.003 ms 2024-01-27T14:43:55.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15141 0.13 MB/sec execute 489 sec latency 321.126 ms 2024-01-27T14:43:56.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15174 0.13 MB/sec execute 490 sec latency 289.226 ms 2024-01-27T14:43:57.484 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:12:55.941 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.486 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:12:55.944 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.539 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:12:55.947 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.540 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:12:55.948 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15199 0.13 MB/sec execute 491 sec latency 289.135 ms 2024-01-27T14:43:57.566 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:12:56.023 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.566 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:12:55.974 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.567 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:12:55.975 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.617 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:12:56.025 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:57.666 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:12:56.074 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:43:58.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15238 0.13 MB/sec execute 492 sec latency 367.763 ms 2024-01-27T14:43:59.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15251 0.13 MB/sec execute 493 sec latency 327.666 ms 2024-01-27T14:43:59.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:43:59.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:44:00.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15267 0.13 MB/sec execute 494 sec latency 310.005 ms 2024-01-27T14:44:01.557 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15303 0.13 MB/sec execute 495 sec latency 312.929 ms 2024-01-27T14:44:02.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15321 0.13 MB/sec execute 496 sec latency 322.199 ms 2024-01-27T14:44:03.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15360 0.13 MB/sec execute 497 sec latency 182.002 ms 2024-01-27T14:44:04.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15371 0.13 MB/sec execute 498 sec latency 436.499 ms 2024-01-27T14:44:05.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15380 0.13 MB/sec execute 499 sec latency 294.680 ms 2024-01-27T14:44:06.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15413 0.13 MB/sec execute 500 sec latency 314.762 ms 2024-01-27T14:44:07.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15449 0.13 MB/sec execute 501 sec latency 227.880 ms 2024-01-27T14:44:08.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15480 0.13 MB/sec execute 502 sec latency 331.551 ms 2024-01-27T14:44:09.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15486 0.13 MB/sec execute 503 sec latency 413.956 ms 2024-01-27T14:44:10.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15579 0.13 MB/sec execute 504 sec latency 294.446 ms 2024-01-27T14:44:11.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15591 0.13 MB/sec execute 505 sec latency 312.036 ms 2024-01-27T14:44:12.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15619 0.13 MB/sec execute 506 sec latency 299.552 ms 2024-01-27T14:44:13.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15648 0.13 MB/sec execute 507 sec latency 303.916 ms 2024-01-27T14:44:14.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15667 0.13 MB/sec execute 508 sec latency 288.451 ms 2024-01-27T14:44:15.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15690 0.13 MB/sec execute 509 sec latency 319.064 ms 2024-01-27T14:44:16.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15714 0.13 MB/sec execute 510 sec latency 349.044 ms 2024-01-27T14:44:17.558 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15732 0.13 MB/sec execute 511 sec latency 319.030 ms 2024-01-27T14:44:18.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15756 0.13 MB/sec execute 512 sec latency 342.082 ms 2024-01-27T14:44:19.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15789 0.13 MB/sec execute 513 sec latency 351.340 ms 2024-01-27T14:44:20.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15811 0.13 MB/sec execute 514 sec latency 321.477 ms 2024-01-27T14:44:21.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15830 0.13 MB/sec execute 515 sec latency 338.877 ms 2024-01-27T14:44:22.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15847 0.13 MB/sec execute 516 sec latency 342.834 ms 2024-01-27T14:44:23.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15888 0.13 MB/sec execute 517 sec latency 250.088 ms 2024-01-27T14:44:24.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15904 0.13 MB/sec execute 518 sec latency 430.936 ms 2024-01-27T14:44:25.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15971 0.13 MB/sec execute 519 sec latency 313.389 ms 2024-01-27T14:44:26.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16005 0.13 MB/sec execute 520 sec latency 292.642 ms 2024-01-27T14:44:27.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16023 0.13 MB/sec execute 521 sec latency 312.242 ms 2024-01-27T14:44:28.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16041 0.13 MB/sec execute 522 sec latency 318.576 ms 2024-01-27T14:44:29.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16063 0.13 MB/sec execute 523 sec latency 305.721 ms 2024-01-27T14:44:30.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:44:30.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:44:30.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16081 0.13 MB/sec execute 524 sec latency 332.155 ms 2024-01-27T14:44:31.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16110 0.13 MB/sec execute 525 sec latency 310.513 ms 2024-01-27T14:44:32.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16151 0.13 MB/sec execute 526 sec latency 292.538 ms 2024-01-27T14:44:33.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16183 0.13 MB/sec execute 527 sec latency 289.304 ms 2024-01-27T14:44:34.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16231 0.13 MB/sec execute 528 sec latency 303.193 ms 2024-01-27T14:44:35.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16249 0.13 MB/sec execute 529 sec latency 299.682 ms 2024-01-27T14:44:36.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16259 0.13 MB/sec execute 530 sec latency 305.239 ms 2024-01-27T14:44:37.559 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16286 0.13 MB/sec execute 531 sec latency 328.831 ms 2024-01-27T14:44:38.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16302 0.13 MB/sec execute 532 sec latency 345.149 ms 2024-01-27T14:44:39.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16344 0.13 MB/sec execute 533 sec latency 301.254 ms 2024-01-27T14:44:40.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16373 0.13 MB/sec execute 534 sec latency 343.558 ms 2024-01-27T14:44:41.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16395 0.13 MB/sec execute 535 sec latency 333.401 ms 2024-01-27T14:44:42.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16429 0.13 MB/sec execute 536 sec latency 319.997 ms 2024-01-27T14:44:43.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16491 0.13 MB/sec execute 537 sec latency 306.258 ms 2024-01-27T14:44:44.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16503 0.13 MB/sec execute 538 sec latency 378.972 ms 2024-01-27T14:44:45.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16520 0.13 MB/sec execute 539 sec latency 434.169 ms 2024-01-27T14:44:46.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16533 0.13 MB/sec execute 540 sec latency 311.872 ms 2024-01-27T14:44:47.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16557 0.13 MB/sec execute 541 sec latency 294.036 ms 2024-01-27T14:44:48.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16562 0.13 MB/sec execute 542 sec latency 455.842 ms 2024-01-27T14:44:49.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16579 0.13 MB/sec execute 543 sec latency 389.015 ms 2024-01-27T14:44:50.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16596 0.13 MB/sec execute 544 sec latency 302.735 ms 2024-01-27T14:44:51.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16624 0.13 MB/sec execute 545 sec latency 307.202 ms 2024-01-27T14:44:52.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16630 0.13 MB/sec execute 546 sec latency 329.989 ms 2024-01-27T14:44:53.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16649 0.13 MB/sec execute 547 sec latency 158.728 ms 2024-01-27T14:44:54.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16680 0.13 MB/sec execute 548 sec latency 462.850 ms 2024-01-27T14:44:55.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16693 0.13 MB/sec execute 549 sec latency 328.626 ms 2024-01-27T14:44:56.560 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16744 0.13 MB/sec execute 550 sec latency 309.871 ms 2024-01-27T14:44:57.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16755 0.13 MB/sec execute 551 sec latency 308.419 ms 2024-01-27T14:44:58.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16776 0.13 MB/sec execute 552 sec latency 329.308 ms 2024-01-27T14:44:59.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16795 0.13 MB/sec execute 553 sec latency 334.684 ms 2024-01-27T14:45:00.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:45:00.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:45:00.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16810 0.13 MB/sec execute 554 sec latency 306.464 ms 2024-01-27T14:45:01.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16816 0.13 MB/sec execute 555 sec latency 339.998 ms 2024-01-27T14:45:02.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16939 0.13 MB/sec execute 556 sec latency 319.237 ms 2024-01-27T14:45:03.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16954 0.13 MB/sec execute 557 sec latency 350.750 ms 2024-01-27T14:45:04.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16973 0.13 MB/sec execute 558 sec latency 209.244 ms 2024-01-27T14:45:05.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17072 0.13 MB/sec execute 559 sec latency 297.621 ms 2024-01-27T14:45:06.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17110 0.13 MB/sec execute 560 sec latency 156.318 ms 2024-01-27T14:45:07.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17136 0.13 MB/sec execute 561 sec latency 321.167 ms 2024-01-27T14:45:08.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17167 0.13 MB/sec execute 562 sec latency 350.970 ms 2024-01-27T14:45:09.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17186 0.13 MB/sec execute 563 sec latency 147.614 ms 2024-01-27T14:45:10.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17210 0.13 MB/sec execute 564 sec latency 297.415 ms 2024-01-27T14:45:11.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17359 0.13 MB/sec execute 565 sec latency 318.621 ms 2024-01-27T14:45:12.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17380 0.13 MB/sec execute 566 sec latency 295.167 ms 2024-01-27T14:45:13.561 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17424 0.13 MB/sec execute 567 sec latency 299.384 ms 2024-01-27T14:45:14.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17464 0.13 MB/sec execute 568 sec latency 398.290 ms 2024-01-27T14:45:15.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17474 0.13 MB/sec execute 569 sec latency 325.307 ms 2024-01-27T14:45:16.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17478 0.13 MB/sec execute 570 sec latency 316.172 ms 2024-01-27T14:45:17.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17483 0.13 MB/sec execute 571 sec latency 356.164 ms 2024-01-27T14:45:18.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17486 0.13 MB/sec execute 572 sec latency 367.395 ms 2024-01-27T14:45:19.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17491 0.13 MB/sec execute 573 sec latency 373.348 ms 2024-01-27T14:45:20.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17498 0.13 MB/sec execute 574 sec latency 360.784 ms 2024-01-27T14:45:21.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17502 0.13 MB/sec execute 575 sec latency 316.268 ms 2024-01-27T14:45:22.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17505 0.13 MB/sec execute 576 sec latency 296.981 ms 2024-01-27T14:45:23.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17509 0.13 MB/sec execute 577 sec latency 333.300 ms 2024-01-27T14:45:24.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17512 0.13 MB/sec execute 578 sec latency 364.024 ms 2024-01-27T14:45:25.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17517 0.13 MB/sec execute 579 sec latency 360.831 ms 2024-01-27T14:45:26.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17522 0.13 MB/sec execute 580 sec latency 322.499 ms 2024-01-27T14:45:27.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17525 0.13 MB/sec execute 581 sec latency 309.708 ms 2024-01-27T14:45:28.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17528 0.13 MB/sec execute 582 sec latency 308.909 ms 2024-01-27T14:45:29.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17545 0.13 MB/sec execute 583 sec latency 314.343 ms 2024-01-27T14:45:30.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:45:30.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:45:30.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17570 0.13 MB/sec execute 584 sec latency 133.341 ms 2024-01-27T14:45:31.562 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17586 0.13 MB/sec execute 585 sec latency 314.118 ms 2024-01-27T14:45:32.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17697 0.14 MB/sec execute 586 sec latency 303.961 ms 2024-01-27T14:45:33.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17722 0.14 MB/sec execute 587 sec latency 314.456 ms 2024-01-27T14:45:34.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17746 0.14 MB/sec execute 588 sec latency 298.266 ms 2024-01-27T14:45:35.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17764 0.14 MB/sec execute 589 sec latency 330.808 ms 2024-01-27T14:45:36.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17811 0.14 MB/sec execute 590 sec latency 392.552 ms 2024-01-27T14:45:37.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17828 0.13 MB/sec execute 591 sec latency 325.384 ms 2024-01-27T14:45:38.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17856 0.13 MB/sec execute 592 sec latency 201.724 ms 2024-01-27T14:45:39.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17869 0.13 MB/sec execute 593 sec latency 334.167 ms 2024-01-27T14:45:40.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17891 0.13 MB/sec execute 594 sec latency 351.075 ms 2024-01-27T14:45:41.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17941 0.14 MB/sec execute 595 sec latency 299.003 ms 2024-01-27T14:45:42.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17962 0.14 MB/sec execute 596 sec latency 309.338 ms 2024-01-27T14:45:43.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17974 0.14 MB/sec execute 597 sec latency 198.604 ms 2024-01-27T14:45:44.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17984 0.14 MB/sec execute 598 sec latency 247.734 ms 2024-01-27T14:45:45.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 18001 0.14 MB/sec execute 599 sec latency 181.487 ms 2024-01-27T14:45:46.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 600 sec 2024-01-27T14:45:47.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 601 sec 2024-01-27T14:45:48.563 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 602 sec 2024-01-27T14:45:49.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 603 sec 2024-01-27T14:45:50.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 604 sec 2024-01-27T14:45:51.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 605 sec 2024-01-27T14:45:52.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 606 sec 2024-01-27T14:45:53.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 607 sec 2024-01-27T14:45:54.564 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 608 sec 2024-01-27T14:45:55.543 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 609 sec 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 2546 64.313 337.628 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Close 1872 1.191 11.869 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 108 182.952 385.476 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 519 71.327 199.191 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 2304 35.623 320.335 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 395 0.963 1.551 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 431 11.889 557.661 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 200 11.950 20.904 2024-01-27T14:45:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: Find 875 313.164 571.102 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 1249 4.104 106.862 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 3996 0.022 1.878 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 8 15.576 16.822 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 8 14.290 16.945 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 173 45.578 130.345 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.135006 MB/sec 1 clients 1 procs max_latency=571.108 ms 2024-01-27T14:45:55.545 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 10 2024-01-27T14:45:55.546 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-27T14:45:55.546 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:45:55.546 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-27T14:45:55.546 INFO:tasks.workunit.client.0.smithi046.stdout:8 of 10 processes prepared for launch 0 sec 2024-01-27T14:45:55.645 INFO:tasks.workunit.client.0.smithi046.stdout:10 of 10 processes prepared for launch 0 sec 2024-01-27T14:45:55.645 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-27T14:45:56.645 INFO:tasks.workunit.client.0.smithi046.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.837 ms 2024-01-27T14:45:57.645 INFO:tasks.workunit.client.0.smithi046.stdout: 0 7 0.00 MB/sec warmup 2 sec latency 472.449 ms 2024-01-27T14:45:58.645 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11 0.35 MB/sec warmup 3 sec latency 741.482 ms 2024-01-27T14:45:59.645 INFO:tasks.workunit.client.0.smithi046.stdout: 8 27 2.21 MB/sec warmup 4 sec latency 777.413 ms 2024-01-27T14:46:00.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:46:00.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:46:00.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 43 3.34 MB/sec warmup 5 sec latency 847.434 ms 2024-01-27T14:46:01.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 59 4.21 MB/sec warmup 6 sec latency 731.900 ms 2024-01-27T14:46:02.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 76 4.88 MB/sec warmup 7 sec latency 727.076 ms 2024-01-27T14:46:03.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 91 5.22 MB/sec warmup 8 sec latency 804.159 ms 2024-01-27T14:46:04.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 107 5.56 MB/sec warmup 9 sec latency 860.664 ms 2024-01-27T14:46:05.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114 5.30 MB/sec warmup 10 sec latency 895.995 ms 2024-01-27T14:46:06.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 120 4.98 MB/sec warmup 11 sec latency 1101.257 ms 2024-01-27T14:46:07.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 128 4.80 MB/sec warmup 12 sec latency 1463.375 ms 2024-01-27T14:46:08.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 134 4.55 MB/sec warmup 13 sec latency 967.096 ms 2024-01-27T14:46:09.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 141 4.36 MB/sec warmup 14 sec latency 1153.794 ms 2024-01-27T14:46:10.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 145 4.14 MB/sec warmup 15 sec latency 1398.387 ms 2024-01-27T14:46:11.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 151 4.01 MB/sec warmup 16 sec latency 978.501 ms 2024-01-27T14:46:12.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159 3.91 MB/sec warmup 17 sec latency 1219.913 ms 2024-01-27T14:46:13.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163 3.77 MB/sec warmup 18 sec latency 1501.055 ms 2024-01-27T14:46:14.645 INFO:tasks.workunit.client.0.smithi046.stdout: 10 167 3.62 MB/sec warmup 19 sec latency 1590.602 ms 2024-01-27T14:46:15.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 174 3.56 MB/sec warmup 20 sec latency 1649.108 ms 2024-01-27T14:46:16.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 176 3.41 MB/sec warmup 21 sec latency 1650.862 ms 2024-01-27T14:46:17.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 183 3.36 MB/sec warmup 22 sec latency 2034.756 ms 2024-01-27T14:46:18.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 189 3.29 MB/sec warmup 23 sec latency 1497.853 ms 2024-01-27T14:46:19.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 195 3.24 MB/sec warmup 24 sec latency 1296.223 ms 2024-01-27T14:46:20.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 199 3.16 MB/sec warmup 25 sec latency 1585.059 ms 2024-01-27T14:46:21.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206 3.11 MB/sec warmup 26 sec latency 1306.413 ms 2024-01-27T14:46:22.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 214 3.09 MB/sec warmup 27 sec latency 1300.386 ms 2024-01-27T14:46:23.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 217 3.01 MB/sec warmup 28 sec latency 1351.644 ms 2024-01-27T14:46:24.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 224 2.99 MB/sec warmup 29 sec latency 1353.665 ms 2024-01-27T14:46:25.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 231 2.96 MB/sec warmup 30 sec latency 1496.472 ms 2024-01-27T14:46:26.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 234 2.90 MB/sec warmup 31 sec latency 1643.335 ms 2024-01-27T14:46:27.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 242 2.89 MB/sec warmup 32 sec latency 1458.038 ms 2024-01-27T14:46:28.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 247 2.86 MB/sec warmup 33 sec latency 1457.448 ms 2024-01-27T14:46:29.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 255 2.84 MB/sec warmup 34 sec latency 1549.706 ms 2024-01-27T14:46:30.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:46:30.718 INFO:tasks.workunit.client.0.smithi046.stdout: 10 258 2.79 MB/sec warmup 35 sec latency 1635.372 ms 2024-01-27T14:46:30.721 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:46:31.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 263 2.76 MB/sec warmup 36 sec latency 2075.227 ms 2024-01-27T14:46:32.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 270 2.75 MB/sec warmup 37 sec latency 2198.065 ms 2024-01-27T14:46:33.646 INFO:tasks.workunit.client.0.smithi046.stdout: 10 274 2.71 MB/sec warmup 38 sec latency 1529.123 ms 2024-01-27T14:46:34.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 279 2.68 MB/sec warmup 39 sec latency 1795.216 ms 2024-01-27T14:46:35.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 282 2.64 MB/sec warmup 40 sec latency 2112.838 ms 2024-01-27T14:46:36.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 288 2.62 MB/sec warmup 41 sec latency 1906.931 ms 2024-01-27T14:46:37.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 292 2.57 MB/sec warmup 42 sec latency 1135.996 ms 2024-01-27T14:46:38.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 300 2.57 MB/sec warmup 43 sec latency 1756.722 ms 2024-01-27T14:46:39.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 305 2.55 MB/sec warmup 44 sec latency 1163.486 ms 2024-01-27T14:46:40.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 310 2.52 MB/sec warmup 45 sec latency 1399.439 ms 2024-01-27T14:46:41.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 316 2.51 MB/sec warmup 46 sec latency 1472.701 ms 2024-01-27T14:46:42.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 323 2.50 MB/sec warmup 47 sec latency 1270.625 ms 2024-01-27T14:46:43.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 329 2.48 MB/sec warmup 48 sec latency 1341.829 ms 2024-01-27T14:46:44.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 336 2.48 MB/sec warmup 49 sec latency 1112.444 ms 2024-01-27T14:46:45.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 338 2.45 MB/sec warmup 50 sec latency 1965.686 ms 2024-01-27T14:46:46.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 342 2.42 MB/sec warmup 51 sec latency 2651.904 ms 2024-01-27T14:46:47.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 348 2.41 MB/sec warmup 52 sec latency 1591.682 ms 2024-01-27T14:46:48.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 356 2.41 MB/sec warmup 53 sec latency 1393.971 ms 2024-01-27T14:46:49.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 360 2.39 MB/sec warmup 54 sec latency 1384.080 ms 2024-01-27T14:46:50.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 364 2.37 MB/sec warmup 55 sec latency 1483.228 ms 2024-01-27T14:46:51.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 371 2.37 MB/sec warmup 56 sec latency 1627.296 ms 2024-01-27T14:46:52.647 INFO:tasks.workunit.client.0.smithi046.stdout: 10 379 2.37 MB/sec warmup 57 sec latency 1309.906 ms 2024-01-27T14:46:53.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 385 2.36 MB/sec warmup 58 sec latency 1449.246 ms 2024-01-27T14:46:54.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391 2.36 MB/sec warmup 59 sec latency 1531.549 ms 2024-01-27T14:46:55.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 393 2.33 MB/sec warmup 60 sec latency 1831.711 ms 2024-01-27T14:46:56.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 399 2.32 MB/sec warmup 61 sec latency 2037.452 ms 2024-01-27T14:46:57.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 402 2.30 MB/sec warmup 62 sec latency 2062.894 ms 2024-01-27T14:46:58.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 409 2.30 MB/sec warmup 63 sec latency 2103.441 ms 2024-01-27T14:46:59.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 417 2.30 MB/sec warmup 64 sec latency 1568.178 ms 2024-01-27T14:47:00.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 418 2.28 MB/sec warmup 65 sec latency 1591.947 ms 2024-01-27T14:47:00.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:47:00.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:47:01.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 426 2.28 MB/sec warmup 66 sec latency 1998.171 ms 2024-01-27T14:47:02.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 430 2.27 MB/sec warmup 67 sec latency 1342.781 ms 2024-01-27T14:47:03.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 437 2.27 MB/sec warmup 68 sec latency 1907.494 ms 2024-01-27T14:47:04.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 440 2.24 MB/sec warmup 69 sec latency 1679.205 ms 2024-01-27T14:47:05.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 446 2.24 MB/sec warmup 70 sec latency 2183.214 ms 2024-01-27T14:47:06.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 448 2.22 MB/sec warmup 71 sec latency 1674.632 ms 2024-01-27T14:47:07.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 454 2.21 MB/sec warmup 72 sec latency 2236.894 ms 2024-01-27T14:47:08.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 460 2.21 MB/sec warmup 73 sec latency 1869.084 ms 2024-01-27T14:47:09.648 INFO:tasks.workunit.client.0.smithi046.stdout: 10 465 2.20 MB/sec warmup 74 sec latency 1769.760 ms 2024-01-27T14:47:10.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 468 2.18 MB/sec warmup 75 sec latency 2006.468 ms 2024-01-27T14:47:11.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 476 2.20 MB/sec warmup 76 sec latency 2572.901 ms 2024-01-27T14:47:12.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 479 2.18 MB/sec warmup 77 sec latency 1498.270 ms 2024-01-27T14:47:13.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 490 2.20 MB/sec warmup 78 sec latency 1561.142 ms 2024-01-27T14:47:14.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 494 2.19 MB/sec warmup 79 sec latency 1733.058 ms 2024-01-27T14:47:15.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 498 2.18 MB/sec warmup 80 sec latency 2485.546 ms 2024-01-27T14:47:16.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 498 2.15 MB/sec warmup 81 sec latency 3485.573 ms 2024-01-27T14:47:17.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 504 2.14 MB/sec warmup 82 sec latency 4485.598 ms 2024-01-27T14:47:18.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 510 2.14 MB/sec warmup 83 sec latency 4862.604 ms 2024-01-27T14:47:19.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 514 2.12 MB/sec warmup 84 sec latency 1373.726 ms 2024-01-27T14:47:20.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 518 2.11 MB/sec warmup 85 sec latency 1743.351 ms 2024-01-27T14:47:21.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 524 2.11 MB/sec warmup 86 sec latency 2243.067 ms 2024-01-27T14:47:22.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 535 2.13 MB/sec warmup 87 sec latency 2972.142 ms 2024-01-27T14:47:23.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 548 2.17 MB/sec warmup 88 sec latency 1321.396 ms 2024-01-27T14:47:24.480 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:22.936 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.482 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:22.939 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.486 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:16:22.893 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.489 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:16:22.896 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.537 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:22.944 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.541 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:22.948 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.571 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:23.028 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.591 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:16:22.998 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.623 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:16:23.030 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:47:24.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 568 2.21 MB/sec warmup 89 sec latency 2199.115 ms 2024-01-27T14:47:25.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 575 2.22 MB/sec warmup 90 sec latency 3199.145 ms 2024-01-27T14:47:26.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 581 2.20 MB/sec warmup 91 sec latency 3221.735 ms 2024-01-27T14:47:27.649 INFO:tasks.workunit.client.0.smithi046.stdout: 10 597 2.24 MB/sec warmup 92 sec latency 2671.290 ms 2024-01-27T14:47:28.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 610 2.26 MB/sec warmup 93 sec latency 2880.897 ms 2024-01-27T14:47:29.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 611 2.23 MB/sec warmup 94 sec latency 2927.242 ms 2024-01-27T14:47:30.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 612 2.21 MB/sec warmup 95 sec latency 2265.503 ms 2024-01-27T14:47:30.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:47:30.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:47:31.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 615 2.19 MB/sec warmup 96 sec latency 2974.208 ms 2024-01-27T14:47:32.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 622 2.17 MB/sec warmup 97 sec latency 2656.907 ms 2024-01-27T14:47:33.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 625 2.14 MB/sec warmup 98 sec latency 2380.319 ms 2024-01-27T14:47:34.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 633 2.12 MB/sec warmup 99 sec latency 2423.467 ms 2024-01-27T14:47:35.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 639 2.10 MB/sec warmup 100 sec latency 2540.905 ms 2024-01-27T14:47:36.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 640 2.08 MB/sec warmup 101 sec latency 2951.295 ms 2024-01-27T14:47:37.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 648 2.07 MB/sec warmup 102 sec latency 3111.367 ms 2024-01-27T14:47:38.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 649 2.05 MB/sec warmup 103 sec latency 2675.476 ms 2024-01-27T14:47:39.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 651 2.03 MB/sec warmup 104 sec latency 2385.123 ms 2024-01-27T14:47:40.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 652 2.01 MB/sec warmup 105 sec latency 2426.189 ms 2024-01-27T14:47:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 654 1.99 MB/sec warmup 106 sec latency 2554.947 ms 2024-01-27T14:47:42.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 656 1.97 MB/sec warmup 107 sec latency 2788.056 ms 2024-01-27T14:47:43.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 662 1.95 MB/sec warmup 108 sec latency 2989.252 ms 2024-01-27T14:47:44.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 667 1.94 MB/sec warmup 109 sec latency 2485.076 ms 2024-01-27T14:47:45.650 INFO:tasks.workunit.client.0.smithi046.stdout: 10 673 1.92 MB/sec warmup 110 sec latency 2063.975 ms 2024-01-27T14:47:46.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 677 1.91 MB/sec warmup 111 sec latency 3064.005 ms 2024-01-27T14:47:47.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 681 1.89 MB/sec warmup 112 sec latency 3283.240 ms 2024-01-27T14:47:48.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 685 1.88 MB/sec warmup 113 sec latency 2664.474 ms 2024-01-27T14:47:49.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 688 1.86 MB/sec warmup 114 sec latency 2450.308 ms 2024-01-27T14:47:50.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 691 1.84 MB/sec warmup 115 sec latency 2423.893 ms 2024-01-27T14:47:51.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 697 1.83 MB/sec warmup 116 sec latency 2485.830 ms 2024-01-27T14:47:52.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 703 1.81 MB/sec warmup 117 sec latency 2824.792 ms 2024-01-27T14:47:53.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 706 1.80 MB/sec warmup 118 sec latency 2916.135 ms 2024-01-27T14:47:54.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 712 1.78 MB/sec warmup 119 sec latency 3012.372 ms 2024-01-27T14:47:56.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 727 0.15 MB/sec execute 1 sec latency 3073.558 ms 2024-01-27T14:47:57.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 733 0.18 MB/sec execute 2 sec latency 1242.144 ms 2024-01-27T14:47:58.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 737 0.13 MB/sec execute 3 sec latency 2231.988 ms 2024-01-27T14:47:59.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 741 0.15 MB/sec execute 4 sec latency 3232.031 ms 2024-01-27T14:48:00.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 744 0.14 MB/sec execute 5 sec latency 3806.306 ms 2024-01-27T14:48:00.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:48:00.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:48:01.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 746 0.12 MB/sec execute 6 sec latency 3542.608 ms 2024-01-27T14:48:02.651 INFO:tasks.workunit.client.0.smithi046.stdout: 10 751 0.11 MB/sec execute 7 sec latency 3192.297 ms 2024-01-27T14:48:03.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.10 MB/sec execute 8 sec latency 3026.317 ms 2024-01-27T14:48:04.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 761 0.10 MB/sec execute 9 sec latency 2564.216 ms 2024-01-27T14:48:05.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 766 0.10 MB/sec execute 10 sec latency 2902.697 ms 2024-01-27T14:48:06.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 772 0.10 MB/sec execute 11 sec latency 3217.188 ms 2024-01-27T14:48:07.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 776 0.11 MB/sec execute 12 sec latency 2185.350 ms 2024-01-27T14:48:08.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 780 0.11 MB/sec execute 13 sec latency 3185.391 ms 2024-01-27T14:48:09.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 786 0.12 MB/sec execute 14 sec latency 3636.677 ms 2024-01-27T14:48:10.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 796 0.13 MB/sec execute 15 sec latency 3810.661 ms 2024-01-27T14:48:11.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 801 0.12 MB/sec execute 16 sec latency 1997.317 ms 2024-01-27T14:48:12.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 803 0.12 MB/sec execute 17 sec latency 2997.343 ms 2024-01-27T14:48:13.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 806 0.11 MB/sec execute 18 sec latency 3160.821 ms 2024-01-27T14:48:14.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 809 0.12 MB/sec execute 19 sec latency 3178.196 ms 2024-01-27T14:48:15.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 812 0.11 MB/sec execute 20 sec latency 2702.534 ms 2024-01-27T14:48:16.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.11 MB/sec execute 21 sec latency 2708.207 ms 2024-01-27T14:48:17.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 818 0.11 MB/sec execute 22 sec latency 2704.960 ms 2024-01-27T14:48:18.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 820 0.10 MB/sec execute 23 sec latency 2502.720 ms 2024-01-27T14:48:18.805 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.262 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.807 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.264 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.809 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:17.216 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.836 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.293 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.859 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:17.266 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.859 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:17.266 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.865 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:17.271 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.887 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:17:17.294 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:18.908 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:17:17.315 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:48:19.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 821 0.10 MB/sec execute 24 sec latency 2266.195 ms 2024-01-27T14:48:20.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 823 0.09 MB/sec execute 25 sec latency 2284.577 ms 2024-01-27T14:48:21.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 831 0.10 MB/sec execute 26 sec latency 2354.941 ms 2024-01-27T14:48:22.652 INFO:tasks.workunit.client.0.smithi046.stdout: 10 835 0.10 MB/sec execute 27 sec latency 2479.309 ms 2024-01-27T14:48:23.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 841 0.10 MB/sec execute 28 sec latency 2494.839 ms 2024-01-27T14:48:24.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 848 0.10 MB/sec execute 29 sec latency 2287.429 ms 2024-01-27T14:48:25.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 850 0.10 MB/sec execute 30 sec latency 2216.506 ms 2024-01-27T14:48:26.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 857 0.11 MB/sec execute 31 sec latency 2329.242 ms 2024-01-27T14:48:27.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 860 0.10 MB/sec execute 32 sec latency 2450.765 ms 2024-01-27T14:48:28.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 861 0.10 MB/sec execute 33 sec latency 2406.290 ms 2024-01-27T14:48:29.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 863 0.10 MB/sec execute 34 sec latency 2923.119 ms 2024-01-27T14:48:30.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 865 0.10 MB/sec execute 35 sec latency 2677.419 ms 2024-01-27T14:48:30.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:48:30.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:48:31.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 868 0.10 MB/sec execute 36 sec latency 2977.050 ms 2024-01-27T14:48:32.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 872 0.10 MB/sec execute 37 sec latency 3147.333 ms 2024-01-27T14:48:33.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 876 0.10 MB/sec execute 38 sec latency 2403.969 ms 2024-01-27T14:48:34.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 880 0.10 MB/sec execute 39 sec latency 2332.762 ms 2024-01-27T14:48:35.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 885 0.10 MB/sec execute 40 sec latency 2793.262 ms 2024-01-27T14:48:36.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 889 0.10 MB/sec execute 41 sec latency 2753.345 ms 2024-01-27T14:48:37.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 891 0.10 MB/sec execute 42 sec latency 2564.093 ms 2024-01-27T14:48:38.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 899 0.10 MB/sec execute 43 sec latency 2974.538 ms 2024-01-27T14:48:39.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 904 0.10 MB/sec execute 44 sec latency 3200.227 ms 2024-01-27T14:48:40.653 INFO:tasks.workunit.client.0.smithi046.stdout: 10 908 0.10 MB/sec execute 45 sec latency 1608.684 ms 2024-01-27T14:48:41.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 910 0.10 MB/sec execute 46 sec latency 2507.306 ms 2024-01-27T14:48:42.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 913 0.10 MB/sec execute 47 sec latency 3507.422 ms 2024-01-27T14:48:43.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 918 0.10 MB/sec execute 48 sec latency 3730.753 ms 2024-01-27T14:48:44.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 922 0.10 MB/sec execute 49 sec latency 3212.536 ms 2024-01-27T14:48:45.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 923 0.10 MB/sec execute 50 sec latency 2912.780 ms 2024-01-27T14:48:46.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 925 0.10 MB/sec execute 51 sec latency 2794.084 ms 2024-01-27T14:48:47.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.10 MB/sec execute 52 sec latency 2916.435 ms 2024-01-27T14:48:48.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.10 MB/sec execute 53 sec latency 2583.074 ms 2024-01-27T14:48:49.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 930 0.10 MB/sec execute 54 sec latency 2323.182 ms 2024-01-27T14:48:50.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 931 0.09 MB/sec execute 55 sec latency 2316.532 ms 2024-01-27T14:48:51.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 931 0.09 MB/sec execute 56 sec latency 2723.682 ms 2024-01-27T14:48:52.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 935 0.09 MB/sec execute 57 sec latency 2923.832 ms 2024-01-27T14:48:53.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 936 0.09 MB/sec execute 58 sec latency 2892.573 ms 2024-01-27T14:48:54.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 938 0.09 MB/sec execute 59 sec latency 2353.975 ms 2024-01-27T14:48:55.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 942 0.09 MB/sec execute 60 sec latency 2452.132 ms 2024-01-27T14:48:56.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 943 0.09 MB/sec execute 61 sec latency 2387.907 ms 2024-01-27T14:48:57.654 INFO:tasks.workunit.client.0.smithi046.stdout: 10 947 0.09 MB/sec execute 62 sec latency 2241.771 ms 2024-01-27T14:48:58.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 955 0.09 MB/sec execute 63 sec latency 2433.225 ms 2024-01-27T14:48:59.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 962 0.10 MB/sec execute 64 sec latency 1564.585 ms 2024-01-27T14:49:00.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 963 0.10 MB/sec execute 65 sec latency 2564.631 ms 2024-01-27T14:49:01.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:49:01.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:49:01.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 969 0.10 MB/sec execute 66 sec latency 3500.286 ms 2024-01-27T14:49:02.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 977 0.10 MB/sec execute 67 sec latency 2552.825 ms 2024-01-27T14:49:03.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 982 0.10 MB/sec execute 68 sec latency 1922.716 ms 2024-01-27T14:49:04.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 984 0.10 MB/sec execute 69 sec latency 2799.576 ms 2024-01-27T14:49:05.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 987 0.10 MB/sec execute 70 sec latency 3198.949 ms 2024-01-27T14:49:06.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 991 0.10 MB/sec execute 71 sec latency 3460.002 ms 2024-01-27T14:49:07.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1002 0.14 MB/sec execute 72 sec latency 3484.660 ms 2024-01-27T14:49:08.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1014 0.17 MB/sec execute 73 sec latency 1493.758 ms 2024-01-27T14:49:09.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1015 0.17 MB/sec execute 74 sec latency 2493.818 ms 2024-01-27T14:49:10.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1016 0.16 MB/sec execute 75 sec latency 2777.315 ms 2024-01-27T14:49:11.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1021 0.18 MB/sec execute 76 sec latency 2919.581 ms 2024-01-27T14:49:12.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1031 0.20 MB/sec execute 77 sec latency 2553.464 ms 2024-01-27T14:49:13.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1032 0.21 MB/sec execute 78 sec latency 2453.074 ms 2024-01-27T14:49:14.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1034 0.21 MB/sec execute 79 sec latency 2574.932 ms 2024-01-27T14:49:15.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1037 0.20 MB/sec execute 80 sec latency 2898.627 ms 2024-01-27T14:49:16.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1040 0.20 MB/sec execute 81 sec latency 2877.989 ms 2024-01-27T14:49:17.655 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1041 0.20 MB/sec execute 82 sec latency 2496.108 ms 2024-01-27T14:49:18.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1043 0.20 MB/sec execute 83 sec latency 2771.879 ms 2024-01-27T14:49:19.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1045 0.19 MB/sec execute 84 sec latency 2681.227 ms 2024-01-27T14:49:20.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1050 0.19 MB/sec execute 85 sec latency 2318.788 ms 2024-01-27T14:49:21.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1051 0.19 MB/sec execute 86 sec latency 2707.733 ms 2024-01-27T14:49:22.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1051 0.19 MB/sec execute 87 sec latency 2910.504 ms 2024-01-27T14:49:23.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1053 0.19 MB/sec execute 88 sec latency 2946.214 ms 2024-01-27T14:49:24.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1056 0.18 MB/sec execute 89 sec latency 2808.318 ms 2024-01-27T14:49:25.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1057 0.18 MB/sec execute 90 sec latency 2508.299 ms 2024-01-27T14:49:26.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1064 0.18 MB/sec execute 91 sec latency 3024.367 ms 2024-01-27T14:49:27.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1065 0.18 MB/sec execute 92 sec latency 3064.703 ms 2024-01-27T14:49:28.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1069 0.18 MB/sec execute 93 sec latency 3251.209 ms 2024-01-27T14:49:29.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1075 0.18 MB/sec execute 94 sec latency 3307.654 ms 2024-01-27T14:49:30.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1080 0.18 MB/sec execute 95 sec latency 2982.319 ms 2024-01-27T14:49:31.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:49:31.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:49:31.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1081 0.17 MB/sec execute 96 sec latency 3025.055 ms 2024-01-27T14:49:32.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1083 0.17 MB/sec execute 97 sec latency 3565.577 ms 2024-01-27T14:49:33.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1088 0.17 MB/sec execute 98 sec latency 3488.285 ms 2024-01-27T14:49:34.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1094 0.17 MB/sec execute 99 sec latency 3573.185 ms 2024-01-27T14:49:35.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1099 0.17 MB/sec execute 100 sec latency 3085.541 ms 2024-01-27T14:49:36.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1102 0.17 MB/sec execute 101 sec latency 3022.237 ms 2024-01-27T14:49:37.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1105 0.17 MB/sec execute 102 sec latency 3451.141 ms 2024-01-27T14:49:38.656 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1107 0.17 MB/sec execute 103 sec latency 3262.044 ms 2024-01-27T14:49:39.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1113 0.16 MB/sec execute 104 sec latency 3332.020 ms 2024-01-27T14:49:40.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1116 0.16 MB/sec execute 105 sec latency 2575.709 ms 2024-01-27T14:49:41.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1119 0.16 MB/sec execute 106 sec latency 2812.003 ms 2024-01-27T14:49:42.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1125 0.16 MB/sec execute 107 sec latency 2812.577 ms 2024-01-27T14:49:43.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1131 0.16 MB/sec execute 108 sec latency 2872.797 ms 2024-01-27T14:49:44.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1136 0.16 MB/sec execute 109 sec latency 2478.058 ms 2024-01-27T14:49:45.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1140 0.16 MB/sec execute 110 sec latency 2592.831 ms 2024-01-27T14:49:46.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1143 0.16 MB/sec execute 111 sec latency 2726.865 ms 2024-01-27T14:49:47.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1147 0.16 MB/sec execute 112 sec latency 1919.166 ms 2024-01-27T14:49:48.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1153 0.15 MB/sec execute 113 sec latency 2077.029 ms 2024-01-27T14:49:49.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1157 0.15 MB/sec execute 114 sec latency 2282.837 ms 2024-01-27T14:49:50.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1161 0.15 MB/sec execute 115 sec latency 2645.896 ms 2024-01-27T14:49:51.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1164 0.15 MB/sec execute 116 sec latency 3160.713 ms 2024-01-27T14:49:52.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1165 0.15 MB/sec execute 117 sec latency 3255.016 ms 2024-01-27T14:49:53.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1168 0.15 MB/sec execute 118 sec latency 3068.936 ms 2024-01-27T14:49:54.657 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1169 0.15 MB/sec execute 119 sec latency 2556.443 ms 2024-01-27T14:49:55.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1171 0.15 MB/sec execute 120 sec latency 2811.914 ms 2024-01-27T14:49:56.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1172 0.15 MB/sec execute 121 sec latency 3080.185 ms 2024-01-27T14:49:57.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1174 0.14 MB/sec execute 122 sec latency 2855.167 ms 2024-01-27T14:49:58.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1177 0.14 MB/sec execute 123 sec latency 3045.086 ms 2024-01-27T14:49:59.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1179 0.14 MB/sec execute 124 sec latency 3132.780 ms 2024-01-27T14:50:00.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1185 0.14 MB/sec execute 125 sec latency 2603.301 ms 2024-01-27T14:50:01.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:50:01.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:50:01.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1188 0.14 MB/sec execute 126 sec latency 2898.188 ms 2024-01-27T14:50:02.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1190 0.14 MB/sec execute 127 sec latency 2791.457 ms 2024-01-27T14:50:03.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1191 0.14 MB/sec execute 128 sec latency 3203.650 ms 2024-01-27T14:50:04.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1197 0.14 MB/sec execute 129 sec latency 3335.595 ms 2024-01-27T14:50:05.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1203 0.14 MB/sec execute 130 sec latency 958.278 ms 2024-01-27T14:50:06.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1206 0.14 MB/sec execute 131 sec latency 1714.369 ms 2024-01-27T14:50:07.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1210 0.14 MB/sec execute 132 sec latency 2714.459 ms 2024-01-27T14:50:08.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1214 0.14 MB/sec execute 133 sec latency 3461.618 ms 2024-01-27T14:50:09.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1223 0.14 MB/sec execute 134 sec latency 2959.206 ms 2024-01-27T14:50:10.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1228 0.13 MB/sec execute 135 sec latency 1453.277 ms 2024-01-27T14:50:11.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1230 0.13 MB/sec execute 136 sec latency 2453.315 ms 2024-01-27T14:50:12.658 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1234 0.13 MB/sec execute 137 sec latency 3020.684 ms 2024-01-27T14:50:13.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1236 0.13 MB/sec execute 138 sec latency 3324.487 ms 2024-01-27T14:50:14.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1241 0.13 MB/sec execute 139 sec latency 3455.725 ms 2024-01-27T14:50:15.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1244 0.13 MB/sec execute 140 sec latency 2794.291 ms 2024-01-27T14:50:16.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1251 0.13 MB/sec execute 141 sec latency 3056.531 ms 2024-01-27T14:50:17.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1257 0.13 MB/sec execute 142 sec latency 3154.151 ms 2024-01-27T14:50:18.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1261 0.13 MB/sec execute 143 sec latency 3500.392 ms 2024-01-27T14:50:19.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1273 0.15 MB/sec execute 144 sec latency 3858.433 ms 2024-01-27T14:50:20.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1276 0.15 MB/sec execute 145 sec latency 3638.310 ms 2024-01-27T14:50:21.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1279 0.15 MB/sec execute 146 sec latency 3689.107 ms 2024-01-27T14:50:22.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1279 0.15 MB/sec execute 147 sec latency 4008.482 ms 2024-01-27T14:50:23.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1281 0.15 MB/sec execute 148 sec latency 3497.478 ms 2024-01-27T14:50:24.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1286 0.15 MB/sec execute 149 sec latency 3306.765 ms 2024-01-27T14:50:25.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.14 MB/sec execute 150 sec latency 2933.766 ms 2024-01-27T14:50:26.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.14 MB/sec execute 151 sec latency 3295.060 ms 2024-01-27T14:50:27.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1290 0.14 MB/sec execute 152 sec latency 3741.640 ms 2024-01-27T14:50:28.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1291 0.14 MB/sec execute 153 sec latency 3333.596 ms 2024-01-27T14:50:29.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1292 0.14 MB/sec execute 154 sec latency 2276.071 ms 2024-01-27T14:50:30.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1309 0.17 MB/sec execute 155 sec latency 2241.016 ms 2024-01-27T14:50:31.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:50:31.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:50:31.659 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1324 0.20 MB/sec execute 156 sec latency 2706.221 ms 2024-01-27T14:50:32.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1339 0.23 MB/sec execute 157 sec latency 2800.223 ms 2024-01-27T14:50:33.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1350 0.25 MB/sec execute 158 sec latency 2859.867 ms 2024-01-27T14:50:34.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1351 0.24 MB/sec execute 159 sec latency 2328.442 ms 2024-01-27T14:50:35.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1353 0.25 MB/sec execute 160 sec latency 2360.779 ms 2024-01-27T14:50:36.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1374 0.28 MB/sec execute 161 sec latency 2486.442 ms 2024-01-27T14:50:37.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1381 0.29 MB/sec execute 162 sec latency 2556.545 ms 2024-01-27T14:50:38.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1383 0.29 MB/sec execute 163 sec latency 2474.007 ms 2024-01-27T14:50:39.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1384 0.29 MB/sec execute 164 sec latency 2373.018 ms 2024-01-27T14:50:40.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1385 0.29 MB/sec execute 165 sec latency 2050.004 ms 2024-01-27T14:50:41.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1387 0.29 MB/sec execute 166 sec latency 2516.233 ms 2024-01-27T14:50:42.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1392 0.28 MB/sec execute 167 sec latency 2582.082 ms 2024-01-27T14:50:43.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1395 0.28 MB/sec execute 168 sec latency 2746.643 ms 2024-01-27T14:50:44.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1398 0.28 MB/sec execute 169 sec latency 2178.337 ms 2024-01-27T14:50:45.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1399 0.28 MB/sec execute 170 sec latency 2008.348 ms 2024-01-27T14:50:46.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1402 0.28 MB/sec execute 171 sec latency 2520.213 ms 2024-01-27T14:50:47.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1407 0.28 MB/sec execute 172 sec latency 2016.746 ms 2024-01-27T14:50:48.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1414 0.28 MB/sec execute 173 sec latency 2161.907 ms 2024-01-27T14:50:49.660 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1416 0.27 MB/sec execute 174 sec latency 1855.511 ms 2024-01-27T14:50:50.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1418 0.27 MB/sec execute 175 sec latency 2406.788 ms 2024-01-27T14:50:51.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1420 0.27 MB/sec execute 176 sec latency 2721.736 ms 2024-01-27T14:50:52.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1427 0.27 MB/sec execute 177 sec latency 2800.775 ms 2024-01-27T14:50:53.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1433 0.27 MB/sec execute 178 sec latency 2562.146 ms 2024-01-27T14:50:54.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1438 0.27 MB/sec execute 179 sec latency 1992.839 ms 2024-01-27T14:50:55.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1442 0.26 MB/sec execute 180 sec latency 2779.931 ms 2024-01-27T14:50:56.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1443 0.26 MB/sec execute 181 sec latency 3251.095 ms 2024-01-27T14:50:57.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1446 0.26 MB/sec execute 182 sec latency 2993.810 ms 2024-01-27T14:50:58.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1451 0.26 MB/sec execute 183 sec latency 3489.680 ms 2024-01-27T14:50:59.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1454 0.26 MB/sec execute 184 sec latency 3162.492 ms 2024-01-27T14:51:00.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1456 0.26 MB/sec execute 185 sec latency 4022.783 ms 2024-01-27T14:51:01.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:51:01.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:51:01.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1458 0.26 MB/sec execute 186 sec latency 4358.205 ms 2024-01-27T14:51:02.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1462 0.26 MB/sec execute 187 sec latency 2531.933 ms 2024-01-27T14:51:03.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1466 0.25 MB/sec execute 188 sec latency 3105.741 ms 2024-01-27T14:51:04.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1469 0.25 MB/sec execute 189 sec latency 1497.399 ms 2024-01-27T14:51:05.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1471 0.25 MB/sec execute 190 sec latency 2273.313 ms 2024-01-27T14:51:06.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1475 0.25 MB/sec execute 191 sec latency 2777.032 ms 2024-01-27T14:51:07.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1480 0.25 MB/sec execute 192 sec latency 2919.146 ms 2024-01-27T14:51:08.661 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1484 0.25 MB/sec execute 193 sec latency 2132.487 ms 2024-01-27T14:51:09.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1485 0.25 MB/sec execute 194 sec latency 2182.043 ms 2024-01-27T14:51:10.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1492 0.25 MB/sec execute 195 sec latency 2394.814 ms 2024-01-27T14:51:11.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1495 0.24 MB/sec execute 196 sec latency 2305.828 ms 2024-01-27T14:51:12.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1496 0.24 MB/sec execute 197 sec latency 2525.874 ms 2024-01-27T14:51:13.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1498 0.24 MB/sec execute 198 sec latency 2671.597 ms 2024-01-27T14:51:14.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1501 0.24 MB/sec execute 199 sec latency 2821.274 ms 2024-01-27T14:51:15.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1506 0.24 MB/sec execute 200 sec latency 2584.993 ms 2024-01-27T14:51:16.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1509 0.24 MB/sec execute 201 sec latency 2128.856 ms 2024-01-27T14:51:17.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1512 0.24 MB/sec execute 202 sec latency 2595.417 ms 2024-01-27T14:51:18.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1517 0.24 MB/sec execute 203 sec latency 2766.710 ms 2024-01-27T14:51:19.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1522 0.24 MB/sec execute 204 sec latency 1670.650 ms 2024-01-27T14:51:20.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1526 0.24 MB/sec execute 205 sec latency 2290.731 ms 2024-01-27T14:51:21.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1530 0.23 MB/sec execute 206 sec latency 2714.654 ms 2024-01-27T14:51:22.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1533 0.23 MB/sec execute 207 sec latency 3359.998 ms 2024-01-27T14:51:23.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1536 0.23 MB/sec execute 208 sec latency 2892.193 ms 2024-01-27T14:51:24.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1541 0.23 MB/sec execute 209 sec latency 3127.553 ms 2024-01-27T14:51:25.662 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1541 0.23 MB/sec execute 210 sec latency 2703.101 ms 2024-01-27T14:51:26.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1542 0.23 MB/sec execute 211 sec latency 2967.296 ms 2024-01-27T14:51:27.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1546 0.23 MB/sec execute 212 sec latency 3132.044 ms 2024-01-27T14:51:28.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1553 0.23 MB/sec execute 213 sec latency 3050.917 ms 2024-01-27T14:51:29.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1556 0.23 MB/sec execute 214 sec latency 3471.183 ms 2024-01-27T14:51:30.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1560 0.23 MB/sec execute 215 sec latency 3334.575 ms 2024-01-27T14:51:31.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:51:31.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:51:31.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1564 0.22 MB/sec execute 216 sec latency 3000.718 ms 2024-01-27T14:51:32.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1569 0.22 MB/sec execute 217 sec latency 2898.538 ms 2024-01-27T14:51:33.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1573 0.22 MB/sec execute 218 sec latency 2272.074 ms 2024-01-27T14:51:34.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1576 0.22 MB/sec execute 219 sec latency 3272.099 ms 2024-01-27T14:51:35.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1581 0.22 MB/sec execute 220 sec latency 3391.219 ms 2024-01-27T14:51:36.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1586 0.22 MB/sec execute 221 sec latency 3777.912 ms 2024-01-27T14:51:37.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1589 0.22 MB/sec execute 222 sec latency 3765.228 ms 2024-01-27T14:51:38.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1594 0.22 MB/sec execute 223 sec latency 2319.106 ms 2024-01-27T14:51:39.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1597 0.22 MB/sec execute 224 sec latency 2796.041 ms 2024-01-27T14:51:40.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1600 0.22 MB/sec execute 225 sec latency 2815.650 ms 2024-01-27T14:51:41.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1604 0.22 MB/sec execute 226 sec latency 2058.238 ms 2024-01-27T14:51:42.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1608 0.22 MB/sec execute 227 sec latency 2266.637 ms 2024-01-27T14:51:43.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1612 0.22 MB/sec execute 228 sec latency 2837.575 ms 2024-01-27T14:51:44.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1615 0.21 MB/sec execute 229 sec latency 2662.622 ms 2024-01-27T14:51:45.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1619 0.21 MB/sec execute 230 sec latency 1971.414 ms 2024-01-27T14:51:46.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1620 0.21 MB/sec execute 231 sec latency 2077.031 ms 2024-01-27T14:51:47.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1621 0.21 MB/sec execute 232 sec latency 2488.973 ms 2024-01-27T14:51:48.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1627 0.21 MB/sec execute 233 sec latency 2490.625 ms 2024-01-27T14:51:49.663 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1631 0.21 MB/sec execute 234 sec latency 1323.023 ms 2024-01-27T14:51:50.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1632 0.21 MB/sec execute 235 sec latency 2000.834 ms 2024-01-27T14:51:51.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1633 0.21 MB/sec execute 236 sec latency 2561.200 ms 2024-01-27T14:51:52.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1637 0.21 MB/sec execute 237 sec latency 2733.998 ms 2024-01-27T14:51:53.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1645 0.21 MB/sec execute 238 sec latency 2387.095 ms 2024-01-27T14:51:54.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1652 0.21 MB/sec execute 239 sec latency 1908.912 ms 2024-01-27T14:51:55.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1657 0.21 MB/sec execute 240 sec latency 2241.338 ms 2024-01-27T14:51:56.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1660 0.21 MB/sec execute 241 sec latency 2580.188 ms 2024-01-27T14:51:57.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1667 0.20 MB/sec execute 242 sec latency 3119.129 ms 2024-01-27T14:51:58.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1669 0.20 MB/sec execute 243 sec latency 2771.035 ms 2024-01-27T14:51:59.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1671 0.20 MB/sec execute 244 sec latency 3295.019 ms 2024-01-27T14:52:00.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1674 0.20 MB/sec execute 245 sec latency 2295.876 ms 2024-01-27T14:52:01.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:52:01.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:52:01.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1677 0.20 MB/sec execute 246 sec latency 3295.917 ms 2024-01-27T14:52:02.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1682 0.20 MB/sec execute 247 sec latency 3777.704 ms 2024-01-27T14:52:03.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1685 0.20 MB/sec execute 248 sec latency 1432.630 ms 2024-01-27T14:52:04.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1690 0.20 MB/sec execute 249 sec latency 1573.614 ms 2024-01-27T14:52:05.664 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1690 0.20 MB/sec execute 250 sec latency 1859.084 ms 2024-01-27T14:52:06.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1702 0.20 MB/sec execute 251 sec latency 2859.119 ms 2024-01-27T14:52:07.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1703 0.20 MB/sec execute 252 sec latency 3859.161 ms 2024-01-27T14:52:08.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1708 0.20 MB/sec execute 253 sec latency 3864.162 ms 2024-01-27T14:52:09.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1710 0.20 MB/sec execute 254 sec latency 1530.062 ms 2024-01-27T14:52:10.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1712 0.20 MB/sec execute 255 sec latency 2530.112 ms 2024-01-27T14:52:11.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1716 0.19 MB/sec execute 256 sec latency 3202.316 ms 2024-01-27T14:52:12.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1716 0.19 MB/sec execute 257 sec latency 2880.158 ms 2024-01-27T14:52:13.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1717 0.19 MB/sec execute 258 sec latency 3880.219 ms 2024-01-27T14:52:14.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1720 0.19 MB/sec execute 259 sec latency 4335.353 ms 2024-01-27T14:52:15.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1723 0.19 MB/sec execute 260 sec latency 4214.061 ms 2024-01-27T14:52:16.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1733 0.19 MB/sec execute 261 sec latency 4553.977 ms 2024-01-27T14:52:17.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1740 0.19 MB/sec execute 262 sec latency 1242.820 ms 2024-01-27T14:52:18.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1741 0.19 MB/sec execute 263 sec latency 2242.857 ms 2024-01-27T14:52:19.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1748 0.19 MB/sec execute 264 sec latency 2835.549 ms 2024-01-27T14:52:20.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1751 0.19 MB/sec execute 265 sec latency 2822.769 ms 2024-01-27T14:52:21.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1753 0.19 MB/sec execute 266 sec latency 3241.523 ms 2024-01-27T14:52:22.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1754 0.19 MB/sec execute 267 sec latency 4241.559 ms 2024-01-27T14:52:23.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1762 0.19 MB/sec execute 268 sec latency 4276.673 ms 2024-01-27T14:52:24.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1773 0.19 MB/sec execute 269 sec latency 4524.782 ms 2024-01-27T14:52:25.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1782 0.19 MB/sec execute 270 sec latency 5524.856 ms 2024-01-27T14:52:26.665 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1784 0.19 MB/sec execute 271 sec latency 6501.492 ms 2024-01-27T14:52:27.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1789 0.19 MB/sec execute 272 sec latency 6550.398 ms 2024-01-27T14:52:28.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1791 0.18 MB/sec execute 273 sec latency 2172.664 ms 2024-01-27T14:52:29.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1793 0.18 MB/sec execute 274 sec latency 2513.619 ms 2024-01-27T14:52:30.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1797 0.18 MB/sec execute 275 sec latency 2398.265 ms 2024-01-27T14:52:31.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1798 0.18 MB/sec execute 276 sec latency 2071.188 ms 2024-01-27T14:52:31.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:52:31.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:52:32.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1802 0.18 MB/sec execute 277 sec latency 3071.287 ms 2024-01-27T14:52:33.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1805 0.18 MB/sec execute 278 sec latency 4071.333 ms 2024-01-27T14:52:34.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1810 0.18 MB/sec execute 279 sec latency 4805.275 ms 2024-01-27T14:52:35.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1814 0.18 MB/sec execute 280 sec latency 5015.976 ms 2024-01-27T14:52:36.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1818 0.18 MB/sec execute 281 sec latency 1493.363 ms 2024-01-27T14:52:37.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1819 0.18 MB/sec execute 282 sec latency 2067.253 ms 2024-01-27T14:52:38.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1819 0.18 MB/sec execute 283 sec latency 2388.121 ms 2024-01-27T14:52:39.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1827 0.18 MB/sec execute 284 sec latency 2327.431 ms 2024-01-27T14:52:40.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1831 0.18 MB/sec execute 285 sec latency 1270.867 ms 2024-01-27T14:52:41.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1832 0.18 MB/sec execute 286 sec latency 2270.940 ms 2024-01-27T14:52:42.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1834 0.18 MB/sec execute 287 sec latency 2724.565 ms 2024-01-27T14:52:43.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1838 0.18 MB/sec execute 288 sec latency 2797.715 ms 2024-01-27T14:52:44.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1841 0.18 MB/sec execute 289 sec latency 2018.367 ms 2024-01-27T14:52:45.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1843 0.18 MB/sec execute 290 sec latency 1855.452 ms 2024-01-27T14:52:46.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1846 0.18 MB/sec execute 291 sec latency 2423.101 ms 2024-01-27T14:52:47.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1851 0.17 MB/sec execute 292 sec latency 2304.559 ms 2024-01-27T14:52:48.666 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1854 0.17 MB/sec execute 293 sec latency 1597.040 ms 2024-01-27T14:52:49.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1856 0.17 MB/sec execute 294 sec latency 2064.560 ms 2024-01-27T14:52:50.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1859 0.17 MB/sec execute 295 sec latency 2243.461 ms 2024-01-27T14:52:51.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1862 0.17 MB/sec execute 296 sec latency 2326.701 ms 2024-01-27T14:52:52.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1870 0.17 MB/sec execute 297 sec latency 2445.248 ms 2024-01-27T14:52:53.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1872 0.17 MB/sec execute 298 sec latency 2509.985 ms 2024-01-27T14:52:54.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1874 0.17 MB/sec execute 299 sec latency 2703.722 ms 2024-01-27T14:52:55.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1878 0.17 MB/sec execute 300 sec latency 2071.704 ms 2024-01-27T14:52:56.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1881 0.17 MB/sec execute 301 sec latency 1779.956 ms 2024-01-27T14:52:57.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1883 0.17 MB/sec execute 302 sec latency 2110.845 ms 2024-01-27T14:52:58.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1887 0.17 MB/sec execute 303 sec latency 2558.731 ms 2024-01-27T14:52:59.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1894 0.17 MB/sec execute 304 sec latency 2399.416 ms 2024-01-27T14:53:00.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1901 0.17 MB/sec execute 305 sec latency 1845.659 ms 2024-01-27T14:53:01.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1904 0.17 MB/sec execute 306 sec latency 2142.392 ms 2024-01-27T14:53:01.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:53:01.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:53:02.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1907 0.17 MB/sec execute 307 sec latency 2670.061 ms 2024-01-27T14:53:03.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1913 0.17 MB/sec execute 308 sec latency 2768.937 ms 2024-01-27T14:53:04.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1916 0.17 MB/sec execute 309 sec latency 2602.555 ms 2024-01-27T14:53:05.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1918 0.17 MB/sec execute 310 sec latency 2492.636 ms 2024-01-27T14:53:06.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1921 0.17 MB/sec execute 311 sec latency 2261.358 ms 2024-01-27T14:53:07.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1923 0.17 MB/sec execute 312 sec latency 2862.821 ms 2024-01-27T14:53:08.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1928 0.17 MB/sec execute 313 sec latency 2545.775 ms 2024-01-27T14:53:09.667 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1932 0.17 MB/sec execute 314 sec latency 2477.286 ms 2024-01-27T14:53:10.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1934 0.17 MB/sec execute 315 sec latency 2832.559 ms 2024-01-27T14:53:11.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1940 0.16 MB/sec execute 316 sec latency 2520.272 ms 2024-01-27T14:53:12.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1942 0.16 MB/sec execute 317 sec latency 2761.183 ms 2024-01-27T14:53:13.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1943 0.16 MB/sec execute 318 sec latency 2986.479 ms 2024-01-27T14:53:14.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1952 0.16 MB/sec execute 319 sec latency 3247.793 ms 2024-01-27T14:53:15.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1964 0.16 MB/sec execute 320 sec latency 2437.333 ms 2024-01-27T14:53:16.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1974 0.16 MB/sec execute 321 sec latency 2178.093 ms 2024-01-27T14:53:17.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1982 0.16 MB/sec execute 322 sec latency 1698.528 ms 2024-01-27T14:53:18.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1986 0.16 MB/sec execute 323 sec latency 2698.569 ms 2024-01-27T14:53:19.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1988 0.16 MB/sec execute 324 sec latency 3698.619 ms 2024-01-27T14:53:20.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1988 0.16 MB/sec execute 325 sec latency 3918.300 ms 2024-01-27T14:53:21.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1988 0.16 MB/sec execute 326 sec latency 3436.045 ms 2024-01-27T14:53:22.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1989 0.16 MB/sec execute 327 sec latency 4436.127 ms 2024-01-27T14:53:23.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1989 0.16 MB/sec execute 328 sec latency 5436.221 ms 2024-01-27T14:53:24.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1993 0.16 MB/sec execute 329 sec latency 5764.063 ms 2024-01-27T14:53:25.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1998 0.16 MB/sec execute 330 sec latency 5978.942 ms 2024-01-27T14:53:26.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2004 0.16 MB/sec execute 331 sec latency 1877.210 ms 2024-01-27T14:53:27.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2008 0.16 MB/sec execute 332 sec latency 2770.106 ms 2024-01-27T14:53:28.668 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2011 0.16 MB/sec execute 333 sec latency 2024.875 ms 2024-01-27T14:53:29.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2013 0.16 MB/sec execute 334 sec latency 2478.975 ms 2024-01-27T14:53:30.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2018 0.16 MB/sec execute 335 sec latency 2127.655 ms 2024-01-27T14:53:31.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2023 0.16 MB/sec execute 336 sec latency 2444.960 ms 2024-01-27T14:53:31.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:53:31.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:53:32.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2027 0.16 MB/sec execute 337 sec latency 2600.693 ms 2024-01-27T14:53:33.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2031 0.16 MB/sec execute 338 sec latency 3600.717 ms 2024-01-27T14:53:34.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2035 0.16 MB/sec execute 339 sec latency 4353.880 ms 2024-01-27T14:53:35.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2040 0.16 MB/sec execute 340 sec latency 3907.628 ms 2024-01-27T14:53:36.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2042 0.16 MB/sec execute 341 sec latency 3557.002 ms 2024-01-27T14:53:37.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2043 0.16 MB/sec execute 342 sec latency 2293.618 ms 2024-01-27T14:53:38.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2048 0.16 MB/sec execute 343 sec latency 2796.641 ms 2024-01-27T14:53:39.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2054 0.16 MB/sec execute 344 sec latency 2086.905 ms 2024-01-27T14:53:40.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2055 0.16 MB/sec execute 345 sec latency 1892.272 ms 2024-01-27T14:53:41.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2059 0.16 MB/sec execute 346 sec latency 2192.149 ms 2024-01-27T14:53:42.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2061 0.15 MB/sec execute 347 sec latency 2361.608 ms 2024-01-27T14:53:43.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2064 0.15 MB/sec execute 348 sec latency 2513.084 ms 2024-01-27T14:53:44.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2065 0.15 MB/sec execute 349 sec latency 2436.603 ms 2024-01-27T14:53:45.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2065 0.15 MB/sec execute 350 sec latency 2415.433 ms 2024-01-27T14:53:46.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2066 0.15 MB/sec execute 351 sec latency 3071.168 ms 2024-01-27T14:53:47.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2067 0.15 MB/sec execute 352 sec latency 3975.001 ms 2024-01-27T14:53:48.669 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2070 0.15 MB/sec execute 353 sec latency 3996.478 ms 2024-01-27T14:53:49.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2074 0.15 MB/sec execute 354 sec latency 3693.422 ms 2024-01-27T14:53:50.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2077 0.15 MB/sec execute 355 sec latency 1494.431 ms 2024-01-27T14:53:51.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2077 0.15 MB/sec execute 356 sec latency 1867.949 ms 2024-01-27T14:53:52.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2079 0.15 MB/sec execute 357 sec latency 2605.044 ms 2024-01-27T14:53:53.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2088 0.15 MB/sec execute 358 sec latency 2643.588 ms 2024-01-27T14:53:54.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2091 0.15 MB/sec execute 359 sec latency 1848.915 ms 2024-01-27T14:53:55.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2093 0.15 MB/sec execute 360 sec latency 2100.529 ms 2024-01-27T14:53:56.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2097 0.15 MB/sec execute 361 sec latency 2488.659 ms 2024-01-27T14:53:57.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2099 0.15 MB/sec execute 362 sec latency 2519.400 ms 2024-01-27T14:53:58.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2104 0.15 MB/sec execute 363 sec latency 2386.163 ms 2024-01-27T14:53:59.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2106 0.15 MB/sec execute 364 sec latency 2561.076 ms 2024-01-27T14:54:00.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2111 0.15 MB/sec execute 365 sec latency 2389.983 ms 2024-01-27T14:54:01.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2116 0.15 MB/sec execute 366 sec latency 2513.221 ms 2024-01-27T14:54:02.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:54:02.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:54:02.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2116 0.15 MB/sec execute 367 sec latency 2829.280 ms 2024-01-27T14:54:03.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2118 0.15 MB/sec execute 368 sec latency 3149.630 ms 2024-01-27T14:54:04.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2124 0.15 MB/sec execute 369 sec latency 3368.886 ms 2024-01-27T14:54:05.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2133 0.15 MB/sec execute 370 sec latency 2665.242 ms 2024-01-27T14:54:06.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2141 0.15 MB/sec execute 371 sec latency 3100.875 ms 2024-01-27T14:54:07.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2152 0.15 MB/sec execute 372 sec latency 1685.499 ms 2024-01-27T14:54:08.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2159 0.15 MB/sec execute 373 sec latency 2082.012 ms 2024-01-27T14:54:09.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2159 0.15 MB/sec execute 374 sec latency 3082.112 ms 2024-01-27T14:54:10.670 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2161 0.15 MB/sec execute 375 sec latency 3318.485 ms 2024-01-27T14:54:11.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2162 0.15 MB/sec execute 376 sec latency 3476.830 ms 2024-01-27T14:54:12.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2163 0.15 MB/sec execute 377 sec latency 3996.219 ms 2024-01-27T14:54:13.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2165 0.15 MB/sec execute 378 sec latency 4449.635 ms 2024-01-27T14:54:14.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2166 0.15 MB/sec execute 379 sec latency 5449.727 ms 2024-01-27T14:54:15.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2166 0.15 MB/sec execute 380 sec latency 6430.727 ms 2024-01-27T14:54:16.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2169 0.15 MB/sec execute 381 sec latency 6547.764 ms 2024-01-27T14:54:17.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2171 0.15 MB/sec execute 382 sec latency 3956.398 ms 2024-01-27T14:54:18.508 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:16.964 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.512 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:16.968 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.518 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:23:16.924 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.521 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:23:16.927 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.521 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:23:16.927 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.523 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:23:16.929 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.648 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:17.103 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.661 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:23:17.067 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:18.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2174 0.15 MB/sec execute 383 sec latency 4297.777 ms 2024-01-27T14:54:18.681 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:23:17.087 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:54:19.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2178 0.15 MB/sec execute 384 sec latency 2630.414 ms 2024-01-27T14:54:20.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2182 0.14 MB/sec execute 385 sec latency 2949.482 ms 2024-01-27T14:54:21.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2186 0.14 MB/sec execute 386 sec latency 2643.006 ms 2024-01-27T14:54:22.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2189 0.14 MB/sec execute 387 sec latency 2082.908 ms 2024-01-27T14:54:23.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2192 0.14 MB/sec execute 388 sec latency 2797.797 ms 2024-01-27T14:54:24.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2194 0.14 MB/sec execute 389 sec latency 2996.464 ms 2024-01-27T14:54:25.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2199 0.14 MB/sec execute 390 sec latency 2724.880 ms 2024-01-27T14:54:26.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2202 0.14 MB/sec execute 391 sec latency 2395.051 ms 2024-01-27T14:54:27.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2206 0.15 MB/sec execute 392 sec latency 2458.476 ms 2024-01-27T14:54:28.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2211 0.15 MB/sec execute 393 sec latency 2433.762 ms 2024-01-27T14:54:29.671 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2215 0.14 MB/sec execute 394 sec latency 1457.959 ms 2024-01-27T14:54:30.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2218 0.14 MB/sec execute 395 sec latency 1606.804 ms 2024-01-27T14:54:31.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2221 0.14 MB/sec execute 396 sec latency 2349.050 ms 2024-01-27T14:54:32.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:54:32.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:54:32.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2228 0.14 MB/sec execute 397 sec latency 3038.681 ms 2024-01-27T14:54:33.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2232 0.14 MB/sec execute 398 sec latency 3107.570 ms 2024-01-27T14:54:34.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2242 0.15 MB/sec execute 399 sec latency 2941.750 ms 2024-01-27T14:54:35.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2249 0.15 MB/sec execute 400 sec latency 1564.845 ms 2024-01-27T14:54:36.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2254 0.15 MB/sec execute 401 sec latency 1857.808 ms 2024-01-27T14:54:37.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2265 0.15 MB/sec execute 402 sec latency 1829.748 ms 2024-01-27T14:54:38.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2269 0.15 MB/sec execute 403 sec latency 2665.592 ms 2024-01-27T14:54:39.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2275 0.15 MB/sec execute 404 sec latency 3421.721 ms 2024-01-27T14:54:40.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2281 0.15 MB/sec execute 405 sec latency 3148.493 ms 2024-01-27T14:54:41.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2290 0.15 MB/sec execute 406 sec latency 3575.454 ms 2024-01-27T14:54:42.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2293 0.15 MB/sec execute 407 sec latency 3525.144 ms 2024-01-27T14:54:43.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2299 0.16 MB/sec execute 408 sec latency 4378.294 ms 2024-01-27T14:54:44.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2306 0.16 MB/sec execute 409 sec latency 4402.268 ms 2024-01-27T14:54:45.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2307 0.16 MB/sec execute 410 sec latency 3636.055 ms 2024-01-27T14:54:46.672 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2307 0.16 MB/sec execute 411 sec latency 2855.561 ms 2024-01-27T14:54:47.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2307 0.16 MB/sec execute 412 sec latency 3627.567 ms 2024-01-27T14:54:48.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2310 0.16 MB/sec execute 413 sec latency 3863.992 ms 2024-01-27T14:54:49.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2314 0.16 MB/sec execute 414 sec latency 3874.747 ms 2024-01-27T14:54:50.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2315 0.16 MB/sec execute 415 sec latency 2188.441 ms 2024-01-27T14:54:51.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2316 0.16 MB/sec execute 416 sec latency 2396.977 ms 2024-01-27T14:54:52.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2317 0.16 MB/sec execute 417 sec latency 2235.225 ms 2024-01-27T14:54:53.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2320 0.16 MB/sec execute 418 sec latency 2416.652 ms 2024-01-27T14:54:54.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2325 0.16 MB/sec execute 419 sec latency 2566.095 ms 2024-01-27T14:54:55.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2327 0.16 MB/sec execute 420 sec latency 2678.599 ms 2024-01-27T14:54:56.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2328 0.16 MB/sec execute 421 sec latency 2618.242 ms 2024-01-27T14:54:57.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2333 0.16 MB/sec execute 422 sec latency 2553.252 ms 2024-01-27T14:54:58.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2335 0.16 MB/sec execute 423 sec latency 2595.366 ms 2024-01-27T14:54:59.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2339 0.16 MB/sec execute 424 sec latency 2534.238 ms 2024-01-27T14:55:00.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2340 0.16 MB/sec execute 425 sec latency 2458.774 ms 2024-01-27T14:55:01.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2342 0.16 MB/sec execute 426 sec latency 2770.224 ms 2024-01-27T14:55:02.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:55:02.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:55:02.673 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2344 0.15 MB/sec execute 427 sec latency 2802.388 ms 2024-01-27T14:55:03.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2347 0.15 MB/sec execute 428 sec latency 2552.772 ms 2024-01-27T14:55:04.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2350 0.15 MB/sec execute 429 sec latency 2903.982 ms 2024-01-27T14:55:05.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2351 0.15 MB/sec execute 430 sec latency 2264.354 ms 2024-01-27T14:55:06.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2351 0.15 MB/sec execute 431 sec latency 3090.899 ms 2024-01-27T14:55:07.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2356 0.15 MB/sec execute 432 sec latency 3021.167 ms 2024-01-27T14:55:08.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2360 0.15 MB/sec execute 433 sec latency 2312.600 ms 2024-01-27T14:55:09.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2361 0.15 MB/sec execute 434 sec latency 1890.861 ms 2024-01-27T14:55:10.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2363 0.15 MB/sec execute 435 sec latency 2687.318 ms 2024-01-27T14:55:11.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2367 0.15 MB/sec execute 436 sec latency 2788.150 ms 2024-01-27T14:55:12.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2370 0.15 MB/sec execute 437 sec latency 1388.892 ms 2024-01-27T14:55:13.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2372 0.15 MB/sec execute 438 sec latency 2388.981 ms 2024-01-27T14:55:14.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2373 0.15 MB/sec execute 439 sec latency 3069.556 ms 2024-01-27T14:55:15.024 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:13.479 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.026 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:13.482 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.059 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:13.514 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.077 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:13.482 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.077 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:13.483 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.082 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:13.488 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.083 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:13.489 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.135 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:24:13.540 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.138 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:24:13.544 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:55:15.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2374 0.15 MB/sec execute 440 sec latency 3121.761 ms 2024-01-27T14:55:16.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2375 0.15 MB/sec execute 441 sec latency 2676.480 ms 2024-01-27T14:55:17.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2378 0.15 MB/sec execute 442 sec latency 2505.491 ms 2024-01-27T14:55:18.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2380 0.15 MB/sec execute 443 sec latency 2784.453 ms 2024-01-27T14:55:19.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2382 0.15 MB/sec execute 444 sec latency 2757.026 ms 2024-01-27T14:55:20.674 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2384 0.15 MB/sec execute 445 sec latency 2598.353 ms 2024-01-27T14:55:21.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2386 0.15 MB/sec execute 446 sec latency 2428.496 ms 2024-01-27T14:55:22.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2388 0.15 MB/sec execute 447 sec latency 2479.224 ms 2024-01-27T14:55:23.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2392 0.15 MB/sec execute 448 sec latency 2778.578 ms 2024-01-27T14:55:24.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2395 0.15 MB/sec execute 449 sec latency 2912.213 ms 2024-01-27T14:55:25.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2398 0.15 MB/sec execute 450 sec latency 2876.827 ms 2024-01-27T14:55:26.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2399 0.15 MB/sec execute 451 sec latency 2648.541 ms 2024-01-27T14:55:27.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2401 0.15 MB/sec execute 452 sec latency 2687.205 ms 2024-01-27T14:55:28.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2406 0.15 MB/sec execute 453 sec latency 2860.083 ms 2024-01-27T14:55:29.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2410 0.15 MB/sec execute 454 sec latency 2949.728 ms 2024-01-27T14:55:30.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2413 0.15 MB/sec execute 455 sec latency 2000.645 ms 2024-01-27T14:55:31.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2414 0.15 MB/sec execute 456 sec latency 3000.726 ms 2024-01-27T14:55:32.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:55:32.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:55:32.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2417 0.15 MB/sec execute 457 sec latency 3160.043 ms 2024-01-27T14:55:33.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2420 0.15 MB/sec execute 458 sec latency 3272.652 ms 2024-01-27T14:55:34.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2426 0.15 MB/sec execute 459 sec latency 2977.368 ms 2024-01-27T14:55:35.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2429 0.15 MB/sec execute 460 sec latency 2414.295 ms 2024-01-27T14:55:36.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2434 0.15 MB/sec execute 461 sec latency 3011.288 ms 2024-01-27T14:55:37.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2437 0.15 MB/sec execute 462 sec latency 3125.694 ms 2024-01-27T14:55:38.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2439 0.15 MB/sec execute 463 sec latency 2618.490 ms 2024-01-27T14:55:39.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2441 0.15 MB/sec execute 464 sec latency 3005.761 ms 2024-01-27T14:55:40.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2447 0.15 MB/sec execute 465 sec latency 2751.954 ms 2024-01-27T14:55:41.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2451 0.15 MB/sec execute 466 sec latency 2902.637 ms 2024-01-27T14:55:42.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2452 0.15 MB/sec execute 467 sec latency 3587.290 ms 2024-01-27T14:55:43.675 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2454 0.15 MB/sec execute 468 sec latency 3697.800 ms 2024-01-27T14:55:44.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2455 0.15 MB/sec execute 469 sec latency 3764.552 ms 2024-01-27T14:55:45.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2458 0.15 MB/sec execute 470 sec latency 3195.456 ms 2024-01-27T14:55:46.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2460 0.15 MB/sec execute 471 sec latency 2331.786 ms 2024-01-27T14:55:47.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2464 0.15 MB/sec execute 472 sec latency 2511.695 ms 2024-01-27T14:55:48.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2465 0.15 MB/sec execute 473 sec latency 3005.972 ms 2024-01-27T14:55:49.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2470 0.15 MB/sec execute 474 sec latency 3112.403 ms 2024-01-27T14:55:50.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2472 0.15 MB/sec execute 475 sec latency 3356.724 ms 2024-01-27T14:55:51.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2476 0.15 MB/sec execute 476 sec latency 2505.417 ms 2024-01-27T14:55:52.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2479 0.15 MB/sec execute 477 sec latency 2868.122 ms 2024-01-27T14:55:53.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2482 0.15 MB/sec execute 478 sec latency 3018.290 ms 2024-01-27T14:55:54.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2486 0.15 MB/sec execute 479 sec latency 3344.186 ms 2024-01-27T14:55:55.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2495 0.16 MB/sec execute 480 sec latency 3392.294 ms 2024-01-27T14:55:56.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2498 0.16 MB/sec execute 481 sec latency 3393.333 ms 2024-01-27T14:55:57.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2501 0.16 MB/sec execute 482 sec latency 2920.688 ms 2024-01-27T14:55:58.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2505 0.16 MB/sec execute 483 sec latency 3294.509 ms 2024-01-27T14:55:59.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2508 0.16 MB/sec execute 484 sec latency 3183.994 ms 2024-01-27T14:56:00.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2510 0.15 MB/sec execute 485 sec latency 3386.762 ms 2024-01-27T14:56:01.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2516 0.15 MB/sec execute 486 sec latency 3012.030 ms 2024-01-27T14:56:02.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:56:02.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:56:02.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2517 0.15 MB/sec execute 487 sec latency 2728.418 ms 2024-01-27T14:56:03.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2519 0.15 MB/sec execute 488 sec latency 2657.456 ms 2024-01-27T14:56:04.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2521 0.15 MB/sec execute 489 sec latency 2729.499 ms 2024-01-27T14:56:05.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2525 0.15 MB/sec execute 490 sec latency 2439.072 ms 2024-01-27T14:56:06.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2532 0.15 MB/sec execute 491 sec latency 2121.536 ms 2024-01-27T14:56:07.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2542 0.15 MB/sec execute 492 sec latency 1979.483 ms 2024-01-27T14:56:08.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2543 0.15 MB/sec execute 493 sec latency 2457.283 ms 2024-01-27T14:56:09.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2552 0.15 MB/sec execute 494 sec latency 2653.772 ms 2024-01-27T14:56:10.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2561 0.15 MB/sec execute 495 sec latency 2412.820 ms 2024-01-27T14:56:11.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2563 0.15 MB/sec execute 496 sec latency 2213.239 ms 2024-01-27T14:56:12.676 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2576 0.16 MB/sec execute 497 sec latency 2566.974 ms 2024-01-27T14:56:13.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2577 0.16 MB/sec execute 498 sec latency 2540.103 ms 2024-01-27T14:56:14.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2578 0.16 MB/sec execute 499 sec latency 2944.528 ms 2024-01-27T14:56:15.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2580 0.16 MB/sec execute 500 sec latency 2959.427 ms 2024-01-27T14:56:16.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2583 0.16 MB/sec execute 501 sec latency 2789.090 ms 2024-01-27T14:56:17.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2587 0.16 MB/sec execute 502 sec latency 2661.478 ms 2024-01-27T14:56:18.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2590 0.16 MB/sec execute 503 sec latency 2730.600 ms 2024-01-27T14:56:19.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2594 0.16 MB/sec execute 504 sec latency 2848.535 ms 2024-01-27T14:56:20.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2596 0.16 MB/sec execute 505 sec latency 2998.769 ms 2024-01-27T14:56:21.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2600 0.16 MB/sec execute 506 sec latency 3002.933 ms 2024-01-27T14:56:22.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2603 0.16 MB/sec execute 507 sec latency 2542.953 ms 2024-01-27T14:56:23.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2604 0.16 MB/sec execute 508 sec latency 2982.413 ms 2024-01-27T14:56:24.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2605 0.16 MB/sec execute 509 sec latency 3140.333 ms 2024-01-27T14:56:25.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2607 0.16 MB/sec execute 510 sec latency 2999.597 ms 2024-01-27T14:56:26.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2610 0.16 MB/sec execute 511 sec latency 2832.064 ms 2024-01-27T14:56:27.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2613 0.16 MB/sec execute 512 sec latency 2696.701 ms 2024-01-27T14:56:28.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2615 0.16 MB/sec execute 513 sec latency 3389.597 ms 2024-01-27T14:56:29.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2616 0.16 MB/sec execute 514 sec latency 3452.749 ms 2024-01-27T14:56:30.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2621 0.16 MB/sec execute 515 sec latency 3028.013 ms 2024-01-27T14:56:31.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2632 0.16 MB/sec execute 516 sec latency 2784.067 ms 2024-01-27T14:56:32.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:56:32.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:56:32.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2635 0.16 MB/sec execute 517 sec latency 2723.399 ms 2024-01-27T14:56:33.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2644 0.16 MB/sec execute 518 sec latency 2236.991 ms 2024-01-27T14:56:34.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2648 0.16 MB/sec execute 519 sec latency 3048.894 ms 2024-01-27T14:56:35.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2651 0.16 MB/sec execute 520 sec latency 2218.961 ms 2024-01-27T14:56:36.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2653 0.16 MB/sec execute 521 sec latency 2482.996 ms 2024-01-27T14:56:37.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2665 0.17 MB/sec execute 522 sec latency 2907.048 ms 2024-01-27T14:56:38.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2667 0.17 MB/sec execute 523 sec latency 2662.453 ms 2024-01-27T14:56:39.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2669 0.17 MB/sec execute 524 sec latency 2653.944 ms 2024-01-27T14:56:40.295 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:38.751 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.351 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:38.806 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.352 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:38.758 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.354 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:38.760 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.355 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:38.761 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.356 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:38.762 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.391 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:25:38.797 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.395 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:25:38.801 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.398 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:38.854 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:56:40.677 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2673 0.17 MB/sec execute 525 sec latency 2540.727 ms 2024-01-27T14:56:41.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2674 0.17 MB/sec execute 526 sec latency 2631.982 ms 2024-01-27T14:56:42.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2676 0.17 MB/sec execute 527 sec latency 2659.598 ms 2024-01-27T14:56:43.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2678 0.17 MB/sec execute 528 sec latency 2436.545 ms 2024-01-27T14:56:44.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2681 0.17 MB/sec execute 529 sec latency 2725.713 ms 2024-01-27T14:56:45.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2696 0.17 MB/sec execute 530 sec latency 2973.569 ms 2024-01-27T14:56:46.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2721 0.19 MB/sec execute 531 sec latency 2218.163 ms 2024-01-27T14:56:47.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2731 0.19 MB/sec execute 532 sec latency 2536.205 ms 2024-01-27T14:56:48.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2756 0.20 MB/sec execute 533 sec latency 2407.838 ms 2024-01-27T14:56:49.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2767 0.20 MB/sec execute 534 sec latency 2606.306 ms 2024-01-27T14:56:50.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2775 0.20 MB/sec execute 535 sec latency 2478.526 ms 2024-01-27T14:56:51.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2785 0.20 MB/sec execute 536 sec latency 2324.706 ms 2024-01-27T14:56:52.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2788 0.20 MB/sec execute 537 sec latency 2204.066 ms 2024-01-27T14:56:53.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2800 0.20 MB/sec execute 538 sec latency 2523.595 ms 2024-01-27T14:56:54.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2803 0.20 MB/sec execute 539 sec latency 2906.177 ms 2024-01-27T14:56:55.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2806 0.20 MB/sec execute 540 sec latency 2877.372 ms 2024-01-27T14:56:56.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2808 0.20 MB/sec execute 541 sec latency 3010.172 ms 2024-01-27T14:56:57.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2812 0.20 MB/sec execute 542 sec latency 2376.392 ms 2024-01-27T14:56:58.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2815 0.20 MB/sec execute 543 sec latency 2681.819 ms 2024-01-27T14:56:59.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2820 0.20 MB/sec execute 544 sec latency 1000.795 ms 2024-01-27T14:57:00.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2823 0.20 MB/sec execute 545 sec latency 1080.412 ms 2024-01-27T14:57:01.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2826 0.20 MB/sec execute 546 sec latency 2080.442 ms 2024-01-27T14:57:02.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2829 0.20 MB/sec execute 547 sec latency 3023.331 ms 2024-01-27T14:57:02.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:57:02.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:57:03.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2833 0.20 MB/sec execute 548 sec latency 3070.714 ms 2024-01-27T14:57:04.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2842 0.20 MB/sec execute 549 sec latency 3232.064 ms 2024-01-27T14:57:05.678 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2849 0.20 MB/sec execute 550 sec latency 3091.583 ms 2024-01-27T14:57:06.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2880 0.20 MB/sec execute 551 sec latency 2182.796 ms 2024-01-27T14:57:07.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2904 0.21 MB/sec execute 552 sec latency 1485.972 ms 2024-01-27T14:57:08.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2906 0.21 MB/sec execute 553 sec latency 2479.270 ms 2024-01-27T14:57:09.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2911 0.21 MB/sec execute 554 sec latency 2611.870 ms 2024-01-27T14:57:10.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2927 0.21 MB/sec execute 555 sec latency 1967.710 ms 2024-01-27T14:57:11.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2934 0.21 MB/sec execute 556 sec latency 2193.410 ms 2024-01-27T14:57:12.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2936 0.21 MB/sec execute 557 sec latency 2336.603 ms 2024-01-27T14:57:13.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2943 0.21 MB/sec execute 558 sec latency 2819.266 ms 2024-01-27T14:57:14.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2945 0.21 MB/sec execute 559 sec latency 3497.627 ms 2024-01-27T14:57:15.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2951 0.22 MB/sec execute 560 sec latency 1436.445 ms 2024-01-27T14:57:16.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2954 0.22 MB/sec execute 561 sec latency 2436.471 ms 2024-01-27T14:57:17.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2962 0.22 MB/sec execute 562 sec latency 3049.718 ms 2024-01-27T14:57:18.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2964 0.22 MB/sec execute 563 sec latency 2235.953 ms 2024-01-27T14:57:19.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2969 0.22 MB/sec execute 564 sec latency 3235.981 ms 2024-01-27T14:57:20.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2971 0.22 MB/sec execute 565 sec latency 3686.036 ms 2024-01-27T14:57:21.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2976 0.22 MB/sec execute 566 sec latency 3642.773 ms 2024-01-27T14:57:22.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2979 0.22 MB/sec execute 567 sec latency 2678.517 ms 2024-01-27T14:57:23.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2983 0.22 MB/sec execute 568 sec latency 2795.113 ms 2024-01-27T14:57:24.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2995 0.22 MB/sec execute 569 sec latency 2845.686 ms 2024-01-27T14:57:25.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3005 0.22 MB/sec execute 570 sec latency 2586.849 ms 2024-01-27T14:57:26.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3007 0.22 MB/sec execute 571 sec latency 2171.655 ms 2024-01-27T14:57:27.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3010 0.22 MB/sec execute 572 sec latency 2361.000 ms 2024-01-27T14:57:28.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3011 0.22 MB/sec execute 573 sec latency 2674.762 ms 2024-01-27T14:57:29.679 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3014 0.22 MB/sec execute 574 sec latency 2727.927 ms 2024-01-27T14:57:30.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3015 0.22 MB/sec execute 575 sec latency 3192.778 ms 2024-01-27T14:57:31.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3018 0.22 MB/sec execute 576 sec latency 3285.947 ms 2024-01-27T14:57:32.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3035 0.22 MB/sec execute 577 sec latency 2704.106 ms 2024-01-27T14:57:32.802 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:57:32.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:57:33.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3051 0.22 MB/sec execute 578 sec latency 2145.790 ms 2024-01-27T14:57:34.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3054 0.22 MB/sec execute 579 sec latency 2709.716 ms 2024-01-27T14:57:35.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3057 0.22 MB/sec execute 580 sec latency 2872.062 ms 2024-01-27T14:57:36.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3059 0.22 MB/sec execute 581 sec latency 2393.182 ms 2024-01-27T14:57:37.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3063 0.22 MB/sec execute 582 sec latency 2422.030 ms 2024-01-27T14:57:38.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3068 0.22 MB/sec execute 583 sec latency 2698.853 ms 2024-01-27T14:57:39.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3070 0.22 MB/sec execute 584 sec latency 3037.794 ms 2024-01-27T14:57:40.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3074 0.22 MB/sec execute 585 sec latency 3149.121 ms 2024-01-27T14:57:41.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3079 0.22 MB/sec execute 586 sec latency 2735.383 ms 2024-01-27T14:57:42.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3083 0.21 MB/sec execute 587 sec latency 2406.078 ms 2024-01-27T14:57:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3085 0.21 MB/sec execute 588 sec latency 3370.456 ms 2024-01-27T14:57:44.554 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:43.010 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.557 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:43.013 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.565 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:26:42.972 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.568 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:26:42.974 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.569 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:26:42.976 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.570 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:26:42.977 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.602 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:43.058 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.612 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:26:43.019 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.627 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:26:43.034 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T14:57:44.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3090 0.21 MB/sec execute 589 sec latency 2850.680 ms 2024-01-27T14:57:45.680 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3108 0.22 MB/sec execute 590 sec latency 3657.237 ms 2024-01-27T14:57:46.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3115 0.22 MB/sec execute 591 sec latency 2991.175 ms 2024-01-27T14:57:47.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3157 0.22 MB/sec execute 592 sec latency 2724.721 ms 2024-01-27T14:57:48.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3171 0.22 MB/sec execute 593 sec latency 2466.015 ms 2024-01-27T14:57:49.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3186 0.22 MB/sec execute 594 sec latency 2543.606 ms 2024-01-27T14:57:50.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3203 0.22 MB/sec execute 595 sec latency 2665.902 ms 2024-01-27T14:57:51.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3204 0.22 MB/sec execute 596 sec latency 2844.822 ms 2024-01-27T14:57:52.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3210 0.22 MB/sec execute 597 sec latency 3059.774 ms 2024-01-27T14:57:53.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3212 0.22 MB/sec execute 598 sec latency 3127.349 ms 2024-01-27T14:57:54.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 3215 0.22 MB/sec execute 599 sec latency 3350.512 ms 2024-01-27T14:57:55.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 600 sec 2024-01-27T14:57:56.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 601 sec 2024-01-27T14:57:57.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 602 sec 2024-01-27T14:57:58.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 603 sec 2024-01-27T14:57:59.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 604 sec 2024-01-27T14:58:00.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 605 sec 2024-01-27T14:58:01.681 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 606 sec 2024-01-27T14:58:02.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 607 sec 2024-01-27T14:58:02.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:58:02.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:58:03.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 608 sec 2024-01-27T14:58:04.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 609 sec 2024-01-27T14:58:05.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 610 sec 2024-01-27T14:58:06.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 611 sec 2024-01-27T14:58:07.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 612 sec 2024-01-27T14:58:08.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 613 sec 2024-01-27T14:58:09.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 614 sec 2024-01-27T14:58:10.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 615 sec 2024-01-27T14:58:11.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 616 sec 2024-01-27T14:58:12.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 617 sec 2024-01-27T14:58:13.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 618 sec 2024-01-27T14:58:14.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 619 sec 2024-01-27T14:58:15.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 620 sec 2024-01-27T14:58:16.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 621 sec 2024-01-27T14:58:17.682 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 622 sec 2024-01-27T14:58:18.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 623 sec 2024-01-27T14:58:19.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 624 sec 2024-01-27T14:58:20.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 625 sec 2024-01-27T14:58:21.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 626 sec 2024-01-27T14:58:22.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 627 sec 2024-01-27T14:58:23.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 628 sec 2024-01-27T14:58:24.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 629 sec 2024-01-27T14:58:25.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 630 sec 2024-01-27T14:58:26.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 631 sec 2024-01-27T14:58:27.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 632 sec 2024-01-27T14:58:28.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 633 sec 2024-01-27T14:58:29.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 634 sec 2024-01-27T14:58:30.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 635 sec 2024-01-27T14:58:31.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 636 sec 2024-01-27T14:58:32.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 637 sec 2024-01-27T14:58:33.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:58:33.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:58:33.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 638 sec 2024-01-27T14:58:34.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 639 sec 2024-01-27T14:58:35.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 640 sec 2024-01-27T14:58:36.683 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 641 sec 2024-01-27T14:58:37.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 642 sec 2024-01-27T14:58:38.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 643 sec 2024-01-27T14:58:39.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 644 sec 2024-01-27T14:58:40.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 645 sec 2024-01-27T14:58:41.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 646 sec 2024-01-27T14:58:42.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 647 sec 2024-01-27T14:58:43.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 648 sec 2024-01-27T14:58:44.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 649 sec 2024-01-27T14:58:45.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 650 sec 2024-01-27T14:58:46.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 651 sec 2024-01-27T14:58:47.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 652 sec 2024-01-27T14:58:48.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 653 sec 2024-01-27T14:58:49.687 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 654 sec 2024-01-27T14:58:50.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 655 sec 2024-01-27T14:58:51.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 656 sec 2024-01-27T14:58:52.684 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 657 sec 2024-01-27T14:58:53.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 658 sec 2024-01-27T14:58:54.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 659 sec 2024-01-27T14:58:55.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 660 sec 2024-01-27T14:58:56.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 661 sec 2024-01-27T14:58:57.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 662 sec 2024-01-27T14:58:58.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 663 sec 2024-01-27T14:58:59.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 664 sec 2024-01-27T14:59:00.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 665 sec 2024-01-27T14:59:01.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 666 sec 2024-01-27T14:59:02.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 667 sec 2024-01-27T14:59:03.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:59:03.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:59:03.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 668 sec 2024-01-27T14:59:04.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 669 sec 2024-01-27T14:59:05.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 670 sec 2024-01-27T14:59:06.685 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 671 sec 2024-01-27T14:59:07.685 INFO:tasks.workunit.client.0.smithi046.stdout: 7 cleanup 672 sec 2024-01-27T14:59:08.395 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 673 sec 2024-01-27T14:59:08.395 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:59:08.395 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-27T14:59:08.395 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-27T14:59:08.395 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 3892 319.385 1700.466 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Close 3217 3.450 45.509 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 206 872.394 1677.389 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 465 293.060 835.609 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 3954 198.131 2096.020 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 845 6.987 68.900 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 513 21.609 142.858 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 456 40.737 162.363 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Find 1284 2715.920 6550.393 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 2303 16.450 848.334 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 7509 0.082 25.502 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 20 124.839 263.631 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 20 148.483 417.992 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 306 294.569 705.229 2024-01-27T14:59:08.396 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T14:59:08.397 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.222067 MB/sec 10 clients 10 procs max_latency=6550.398 ms 2024-01-27T14:59:08.397 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-27T14:59:08.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-27T14:59:30.608 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-01-27T14:59:30.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-27T14:59:30.892 DEBUG:teuthology.parallel:result is None 2024-01-27T14:59:30.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-27T14:59:31.155 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-27T14:59:31.155 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-27T14:59:31.166 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-27T14:59:31.166 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:59:31.166 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:59:31.182 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:59:31.182 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:59:31.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:59:31.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 Processor -- start 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 -- start start 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2938153a30 0x7f29380cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f293806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2938153e10 con 0x7f293806c460 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293806ba90 con 0x7f2938153a30 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.378+0000 7f2940007640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293815cce0 con 0x7f29380cd360 2024-01-27T14:59:31.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.379+0000 7f293e5a4640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f293806c460 0x7f2938159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52742/0 (socket says 172.21.15.46:52742) 2024-01-27T14:59:31.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.379+0000 7f293e5a4640 1 -- 172.21.15.46:0/1297450605 learned_addr learned my addr 172.21.15.46:0/1297450605 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:31.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.379+0000 7f293dda3640 1 --2- 172.21.15.46:0/1297450605 >> v2:172.21.15.73:3300/0 conn(0x7f2938153a30 0x7f29380cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:31.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.379+0000 7f293d5a2640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f293806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.382+0000 7f293dda3640 1 -- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 msgr2=0x7f293806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.382+0000 7f293dda3640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f293806bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.382+0000 7f293dda3640 1 -- 172.21.15.46:0/1297450605 >> v1:172.21.15.46:6789/0 conn(0x7f293806c460 legacy=0x7f2938159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.382+0000 7f293dda3640 1 -- 172.21.15.46:0/1297450605 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293806c8c0 con 0x7f2938153a30 2024-01-27T14:59:31.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.384+0000 7f293dda3640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2938153a30 0x7f29380cce20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f29340097a0 tx=0x7f293402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd1f17cc3432459 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.387+0000 7f293cda1640 1 -- 172.21.15.46:0/1297450605 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934030610 con 0x7f2938153a30 2024-01-27T14:59:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.387+0000 7f293cda1640 1 -- 172.21.15.46:0/1297450605 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934030770 con 0x7f2938153a30 2024-01-27T14:59:31.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.387+0000 7f293cda1640 1 -- 172.21.15.46:0/1297450605 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934030b00 con 0x7f2938153a30 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 -- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2938153a30 msgr2=0x7f29380cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2938153a30 0x7f29380cce20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f29340097a0 tx=0x7f293402b960 comp rx=0 tx=0).stop 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 -- 172.21.15.46:0/1297450605 shutdown_connections 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f293806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 --2- 172.21.15.46:0/1297450605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2938153a30 0x7f29380cce20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 -- 172.21.15.46:0/1297450605 >> 172.21.15.46:0/1297450605 conn(0x7f293806a6c0 msgr2=0x7f293806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 -- 172.21.15.46:0/1297450605 shutdown_connections 2024-01-27T14:59:31.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.388+0000 7f2940007640 1 -- 172.21.15.46:0/1297450605 wait complete. 2024-01-27T14:59:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.389+0000 7f2940007640 1 Processor -- start 2024-01-27T14:59:31.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.389+0000 7f2940007640 1 -- start start 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f29381ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2938153a30 0x7f29381488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29381f3390 con 0x7f2938153a30 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293814dda0 con 0x7f293806c460 2024-01-27T14:59:31.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f2940007640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29380cc950 con 0x7f29380cd360 2024-01-27T14:59:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.390+0000 7f293dda3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.391+0000 7f293d5a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f29381ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.391+0000 7f293dda3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48850/0 (socket says 172.21.15.46:48850) 2024-01-27T14:59:31.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.391+0000 7f293dda3640 1 -- 172.21.15.46:0/4234473447 learned_addr learned my addr 172.21.15.46:0/4234473447 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.394+0000 7f293dda3640 1 -- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 msgr2=0x7f29381ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.394+0000 7f293dda3640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f29381ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.394+0000 7f293dda3640 1 -- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2938153a30 msgr2=0x7f29381488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.394+0000 7f293dda3640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2938153a30 0x7f29381488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.394+0000 7f293dda3640 1 -- 172.21.15.46:0/4234473447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009400 con 0x7f293806c460 2024-01-27T14:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.397+0000 7f293dda3640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2934009890 tx=0x7f29340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.400+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293403e070 con 0x7f293806c460 2024-01-27T14:59:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.400+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340397a0 con 0x7f293806c460 2024-01-27T14:59:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.400+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29381f37b0 con 0x7f293806c460 2024-01-27T14:59:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.400+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934039b70 con 0x7f293806c460 2024-01-27T14:59:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.400+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29380ccef0 con 0x7f293806c460 2024-01-27T14:59:31.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.401+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29381f3600 con 0x7f293806c460 2024-01-27T14:59:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.422+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2934039cd0 con 0x7f293806c460 2024-01-27T14:59:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.423+0000 7f292e7fc640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.423+0000 7f293d5a2640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.423+0000 7f293d5a2640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 0x7f291c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f293815cc10 tx=0x7f2928009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.425+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2934079e80 con 0x7f293806c460 2024-01-27T14:59:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.655+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f29340761c0 con 0x7f293806c460 2024-01-27T14:59:31.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.843+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f293806d960 con 0x7f293806c460 2024-01-27T14:59:31.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.977+0000 7f292e7fc640 1 -- 172.21.15.46:0/4234473447 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f29340797e0 con 0x7f293806c460 2024-01-27T14:59:31.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:31.981 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:59:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 msgr2=0x7f291c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 0x7f291c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f293815cc10 tx=0x7f2928009190 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 msgr2=0x7f29381584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2934009890 tx=0x7f29340046c0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 shutdown_connections 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2938153a30 0x7f29381488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29380cd360 0x7f29381ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 --2- 172.21.15.46:0/4234473447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f293806c460 0x7f29381584d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 >> 172.21.15.46:0/4234473447 conn(0x7f293806a6c0 msgr2=0x7f293806cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 shutdown_connections 2024-01-27T14:59:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:31.980+0000 7f2940007640 1 -- 172.21.15.46:0/4234473447 wait complete. 2024-01-27T14:59:31.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:59:31.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:59:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.097+0000 7f7b9170d640 1 Processor -- start 2024-01-27T14:59:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.097+0000 7f7b9170d640 1 -- start start 2024-01-27T14:59:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.098+0000 7f7b9170d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b8c0ca3d0 0x7f7b8c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.098+0000 7f7b9170d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b8c0c9380 0x7f7b8c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.098+0000 7f7b9170d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c15aad0 con 0x7f7b8c151810 2024-01-27T14:59:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.098+0000 7f7b9170d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c158500 con 0x7f7b8c0ca3d0 2024-01-27T14:59:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.098+0000 7f7b9170d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c97d0 con 0x7f7b8c0c9380 2024-01-27T14:59:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.099+0000 7f7b8a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b8c0ca3d0 0x7f7b8c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.099+0000 7f7b8b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b8c0c9380 0x7f7b8c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.099+0000 7f7b8b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b8c0c9380 0x7f7b8c15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48860/0 (socket says 172.21.15.46:48860) 2024-01-27T14:59:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.099+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/845806278 learned_addr learned my addr 172.21.15.46:0/845806278 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.101+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/845806278 >> v2:172.21.15.46:3300/0 conn(0x7f7b8c0ca3d0 msgr2=0x7f7b8c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.101+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/845806278 >> v2:172.21.15.46:3300/0 conn(0x7f7b8c0ca3d0 0x7f7b8c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.101+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/845806278 >> v1:172.21.15.46:6789/0 conn(0x7f7b8c151810 legacy=0x7f7b8c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.101+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/845806278 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c15b090 con 0x7f7b8c0c9380 2024-01-27T14:59:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.103+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/845806278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c0c9380 0x7f7b8c15b520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c06f090 tx=0x7f7b7c02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fc99556b7dd5f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.107+0000 7f7b89ffb640 1 -- 172.21.15.46:0/845806278 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c02cbb0 con 0x7f7b8c0c9380 2024-01-27T14:59:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.107+0000 7f7b89ffb640 1 -- 172.21.15.46:0/845806278 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c02cd10 con 0x7f7b8c0c9380 2024-01-27T14:59:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.107+0000 7f7b89ffb640 1 -- 172.21.15.46:0/845806278 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c034610 con 0x7f7b8c0c9380 2024-01-27T14:59:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 -- 172.21.15.46:0/845806278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c0c9380 msgr2=0x7f7b8c15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 --2- 172.21.15.46:0/845806278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c0c9380 0x7f7b8c15b520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c06f090 tx=0x7f7b7c02c010 comp rx=0 tx=0).stop 2024-01-27T14:59:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 -- 172.21.15.46:0/845806278 shutdown_connections 2024-01-27T14:59:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 --2- 172.21.15.46:0/845806278 >> v2:172.21.15.46:3300/0 conn(0x7f7b8c0ca3d0 0x7f7b8c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 --2- 172.21.15.46:0/845806278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c0c9380 0x7f7b8c15b520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 -- 172.21.15.46:0/845806278 >> 172.21.15.46:0/845806278 conn(0x7f7b8c066c80 msgr2=0x7f7b8c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 -- 172.21.15.46:0/845806278 shutdown_connections 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.108+0000 7f7b9170d640 1 -- 172.21.15.46:0/845806278 wait complete. 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.109+0000 7f7b9170d640 1 Processor -- start 2024-01-27T14:59:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 -- start start 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b8c0c9380 0x7f7b8c1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b8c0ca3d0 0x7f7b8c146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c155c80 con 0x7f7b8c0ca3d0 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c1f0930 con 0x7f7b8c151810 2024-01-27T14:59:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.110+0000 7f7b9170d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0cc7f0 con 0x7f7b8c0c9380 2024-01-27T14:59:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.111+0000 7f7b8a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b8c0ca3d0 0x7f7b8c146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.111+0000 7f7b8b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.111+0000 7f7b8affd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b8c0c9380 0x7f7b8c1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.111+0000 7f7b8b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48870/0 (socket says 172.21.15.46:48870) 2024-01-27T14:59:32.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.111+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/970862364 learned_addr learned my addr 172.21.15.46:0/970862364 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.114+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b8c0c9380 msgr2=0x7f7b8c1f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.114+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b8c0c9380 0x7f7b8c1f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.114+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b8c0ca3d0 msgr2=0x7f7b8c146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.114+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b8c0ca3d0 0x7f7b8c146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.114+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/970862364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c009b30 con 0x7f7b8c151810 2024-01-27T14:59:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.118+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c036040 tx=0x7f7b7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.121+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c03e450 con 0x7f7b8c151810 2024-01-27T14:59:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.121+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c03e5b0 con 0x7f7b8c151810 2024-01-27T14:59:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.121+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c03e960 con 0x7f7b8c151810 2024-01-27T14:59:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.121+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c0ccad0 con 0x7f7b8c151810 2024-01-27T14:59:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.122+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c14fe10 con 0x7f7b8c151810 2024-01-27T14:59:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.123+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c0c2e00 con 0x7f7b8c151810 2024-01-27T14:59:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.141+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7b7c03eac0 con 0x7f7b8c151810 2024-01-27T14:59:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.142+0000 7f7b837fe640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 0x7f7b6c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.142+0000 7f7b8affd640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 0x7f7b6c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.142+0000 7f7b8affd640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 0x7f7b6c06d3e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b840016e0 tx=0x7f7b84009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.145+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7b7c07b3e0 con 0x7f7b8c151810 2024-01-27T14:59:32.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.407+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7b7c077720 con 0x7f7b8c151810 2024-01-27T14:59:32.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.586+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b8c151bf0 con 0x7f7b8c151810 2024-01-27T14:59:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.592+0000 7f7b837fe640 1 -- 172.21.15.46:0/970862364 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b7c0430a0 con 0x7f7b8c151810 2024-01-27T14:59:32.594 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:59:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 msgr2=0x7f7b6c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 0x7f7b6c06d3e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b840016e0 tx=0x7f7b84009040 comp rx=0 tx=0).stop 2024-01-27T14:59:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 msgr2=0x7f7b8c14e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c036040 tx=0x7f7b7c004a40 comp rx=0 tx=0).stop 2024-01-27T14:59:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 shutdown_connections 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7b6c06af20 0x7f7b6c06d3e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b8c151810 0x7f7b8c14e490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b8c0ca3d0 0x7f7b8c146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 --2- 172.21.15.46:0/970862364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b8c0c9380 0x7f7b8c1f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 >> 172.21.15.46:0/970862364 conn(0x7f7b8c066c80 msgr2=0x7f7b8c159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 shutdown_connections 2024-01-27T14:59:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.593+0000 7f7b9170d640 1 -- 172.21.15.46:0/970862364 wait complete. 2024-01-27T14:59:32.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:59:32.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.720+0000 7f7c144a6640 1 Processor -- start 2024-01-27T14:59:32.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.720+0000 7f7c144a6640 1 -- start start 2024-01-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c144a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c0c0710f0 0x7f7c0c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c144a6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7c0c15d9d0 0x7f7c0c153580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c144a6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0ca870 con 0x7f7c0c0714d0 2024-01-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c144a6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c7ba0 con 0x7f7c0c15d9d0 2024-01-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c144a6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c159a60 con 0x7f7c0c0710f0 2024-01-27T14:59:32.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.721+0000 7f7c12a43640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7c0c15d9d0 0x7f7c0c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.722+0000 7f7c12242640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c0c0710f0 0x7f7c0c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.722+0000 7f7c12242640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c0c0710f0 0x7f7c0c0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48886/0 (socket says 172.21.15.46:48886) 2024-01-27T14:59:32.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.722+0000 7f7c12242640 1 -- 172.21.15.46:0/3908610150 learned_addr learned my addr 172.21.15.46:0/3908610150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.724+0000 7f7c12242640 1 -- 172.21.15.46:0/3908610150 >> v2:172.21.15.46:3300/0 conn(0x7f7c0c15d9d0 msgr2=0x7f7c0c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.724+0000 7f7c12242640 1 --2- 172.21.15.46:0/3908610150 >> v2:172.21.15.46:3300/0 conn(0x7f7c0c15d9d0 0x7f7c0c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.724+0000 7f7c12242640 1 -- 172.21.15.46:0/3908610150 >> v1:172.21.15.46:6789/0 conn(0x7f7c0c0714d0 legacy=0x7f7c0c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.724+0000 7f7c12242640 1 -- 172.21.15.46:0/3908610150 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c159d40 con 0x7f7c0c0710f0 2024-01-27T14:59:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.726+0000 7f7c12242640 1 --2- 172.21.15.46:0/3908610150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c0710f0 0x7f7c0c0ca330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06d9b0 tx=0x7f7c0802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee85759d3ddb5f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:32.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.729+0000 7f7c11240640 1 -- 172.21.15.46:0/3908610150 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0802f850 con 0x7f7c0c0710f0 2024-01-27T14:59:32.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.729+0000 7f7c11240640 1 -- 172.21.15.46:0/3908610150 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0802f9b0 con 0x7f7c0c0710f0 2024-01-27T14:59:32.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.729+0000 7f7c11240640 1 -- 172.21.15.46:0/3908610150 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0802fd40 con 0x7f7c0c0710f0 2024-01-27T14:59:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 -- 172.21.15.46:0/3908610150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c0710f0 msgr2=0x7f7c0c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 --2- 172.21.15.46:0/3908610150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c0710f0 0x7f7c0c0ca330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06d9b0 tx=0x7f7c0802ba30 comp rx=0 tx=0).stop 2024-01-27T14:59:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 -- 172.21.15.46:0/3908610150 shutdown_connections 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 --2- 172.21.15.46:0/3908610150 >> v2:172.21.15.46:3300/0 conn(0x7f7c0c15d9d0 0x7f7c0c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 --2- 172.21.15.46:0/3908610150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c0710f0 0x7f7c0c0ca330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 -- 172.21.15.46:0/3908610150 >> 172.21.15.46:0/3908610150 conn(0x7f7c0c066ac0 msgr2=0x7f7c0c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 -- 172.21.15.46:0/3908610150 shutdown_connections 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.730+0000 7f7c144a6640 1 -- 172.21.15.46:0/3908610150 wait complete. 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.731+0000 7f7c144a6640 1 Processor -- start 2024-01-27T14:59:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.731+0000 7f7c144a6640 1 -- start start 2024-01-27T14:59:32.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c0c0710f0 0x7f7c0c0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 0x7f7c0c1efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 0x7f7c0c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:32.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0cb570 con 0x7f7c0c0714d0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c5470 con 0x7f7c0c15d9d0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c144a6640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1ef3d0 con 0x7f7c0c0710f0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c11a41640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 0x7f7c0c1efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c12a43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 0x7f7c0c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.732+0000 7f7c12242640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c0c0710f0 0x7f7c0c0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.733+0000 7f7c12a43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 0x7f7c0c1518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48898/0 (socket says 172.21.15.46:48898) 2024-01-27T14:59:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.733+0000 7f7c12a43640 1 -- 172.21.15.46:0/2988110369 learned_addr learned my addr 172.21.15.46:0/2988110369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.736+0000 7f7c11a41640 1 -- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c0c0710f0 msgr2=0x7f7c0c0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.736+0000 7f7c11a41640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c0c0710f0 0x7f7c0c0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.736+0000 7f7c11a41640 1 -- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 msgr2=0x7f7c0c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.736+0000 7f7c11a41640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 0x7f7c0c1518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.736+0000 7f7c11a41640 1 -- 172.21.15.46:0/2988110369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080094d0 con 0x7f7c0c0714d0 2024-01-27T14:59:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.738+0000 7f7c11a41640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 0x7f7c0c1efde0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c340 tx=0x7f7bfc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.742+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0052d0 con 0x7f7c0c0714d0 2024-01-27T14:59:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.742+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc005450 con 0x7f7c0c0714d0 2024-01-27T14:59:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.742+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc007260 con 0x7f7c0c0714d0 2024-01-27T14:59:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.742+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c1ef950 con 0x7f7c0c0714d0 2024-01-27T14:59:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.742+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c0c4eb0 con 0x7f7c0c0714d0 2024-01-27T14:59:32.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:32.743+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c1efae0 con 0x7f7c0c0714d0 2024-01-27T14:59:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.012+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7bfc0073c0 con 0x7f7c0c0714d0 2024-01-27T14:59:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.013+0000 7f7c02ffd640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 0x7f7bf006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.013+0000 7f7c12242640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 0x7f7bf006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.014+0000 7f7c12242640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 0x7f7bf006d410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c08036000 tx=0x7f7c08008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.027+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7bfc057a10 con 0x7f7c0c0714d0 2024-01-27T14:59:33.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.027+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7bfc053d50 con 0x7f7c0c0714d0 2024-01-27T14:59:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.214+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c0c0742e0 con 0x7f7c0c0714d0 2024-01-27T14:59:33.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.219+0000 7f7c02ffd640 1 -- 172.21.15.46:0/2988110369 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bfc0200a0 con 0x7f7c0c0714d0 2024-01-27T14:59:33.223 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 msgr2=0x7f7bf006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 0x7f7bf006d410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c08036000 tx=0x7f7c08008030 comp rx=0 tx=0).stop 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 msgr2=0x7f7c0c1efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 0x7f7c0c1efde0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c340 tx=0x7f7bfc00c800 comp rx=0 tx=0).stop 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 shutdown_connections 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7bf006af50 0x7f7bf006d410 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c0c15d9d0 0x7f7c0c1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c0c0714d0 0x7f7c0c1efde0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 --2- 172.21.15.46:0/2988110369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c0c0710f0 0x7f7c0c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 >> 172.21.15.46:0/2988110369 conn(0x7f7c0c066ac0 msgr2=0x7f7c0c0c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 shutdown_connections 2024-01-27T14:59:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.221+0000 7f7c144a6640 1 -- 172.21.15.46:0/2988110369 wait complete. 2024-01-27T14:59:33.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:59:33.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:59:33.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:59:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.343+0000 7f59c0ae5640 1 Processor -- start 2024-01-27T14:59:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.343+0000 7f59c0ae5640 1 -- start start 2024-01-27T14:59:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59c0ae5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59bc071e70 0x7f59bc0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59c0ae5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59bc0c8640 0x7f59bc072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59c0ae5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0bff20 con 0x7f59bc0c6310 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59c0ae5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc06e4b0 con 0x7f59bc071e70 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59c0ae5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0c06f0 con 0x7f59bc0c8640 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.344+0000 7f59ba59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59bc071e70 0x7f59bc0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.345+0000 7f59bad9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59bc0c8640 0x7f59bc072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.345+0000 7f59ba59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59bc071e70 0x7f59bc0c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47996/0 (socket says 172.21.15.46:47996) 2024-01-27T14:59:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.345+0000 7f59ba59c640 1 -- 172.21.15.46:0/2929202108 learned_addr learned my addr 172.21.15.46:0/2929202108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.347+0000 7f59ba59c640 1 -- 172.21.15.46:0/2929202108 >> v2:172.21.15.73:3300/0 conn(0x7f59bc0c8640 msgr2=0x7f59bc072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.347+0000 7f59ba59c640 1 --2- 172.21.15.46:0/2929202108 >> v2:172.21.15.73:3300/0 conn(0x7f59bc0c8640 0x7f59bc072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.347+0000 7f59ba59c640 1 -- 172.21.15.46:0/2929202108 >> v1:172.21.15.73:6789/0 conn(0x7f59bc0c6310 legacy=0x7f59bc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.347+0000 7f59ba59c640 1 -- 172.21.15.46:0/2929202108 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0c0150 con 0x7f59bc071e70 2024-01-27T14:59:33.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.349+0000 7f59ba59c640 1 --2- 172.21.15.46:0/2929202108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc071e70 0x7f59bc0c1ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06ebe0 tx=0x7f59ac02cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ea0921ee53b2fe server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59b9d9b640 1 -- 172.21.15.46:0/2929202108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac02dcc0 con 0x7f59bc071e70 2024-01-27T14:59:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59b9d9b640 1 -- 172.21.15.46:0/2929202108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac02de20 con 0x7f59bc071e70 2024-01-27T14:59:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59b9d9b640 1 -- 172.21.15.46:0/2929202108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac035660 con 0x7f59bc071e70 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59c0ae5640 1 -- 172.21.15.46:0/2929202108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc071e70 msgr2=0x7f59bc0c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/2929202108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc071e70 0x7f59bc0c1ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06ebe0 tx=0x7f59ac02cf10 comp rx=0 tx=0).stop 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.353+0000 7f59c0ae5640 1 -- 172.21.15.46:0/2929202108 shutdown_connections 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.354+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/2929202108 >> v2:172.21.15.73:3300/0 conn(0x7f59bc0c8640 0x7f59bc072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.354+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/2929202108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc071e70 0x7f59bc0c1ba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.354+0000 7f59c0ae5640 1 -- 172.21.15.46:0/2929202108 >> 172.21.15.46:0/2929202108 conn(0x7f59bc0c7a00 msgr2=0x7f59bc0c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.354+0000 7f59c0ae5640 1 -- 172.21.15.46:0/2929202108 shutdown_connections 2024-01-27T14:59:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.354+0000 7f59c0ae5640 1 -- 172.21.15.46:0/2929202108 wait complete. 2024-01-27T14:59:33.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.355+0000 7f59c0ae5640 1 Processor -- start 2024-01-27T14:59:33.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.355+0000 7f59c0ae5640 1 -- start start 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 0x7f59bc1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59bc0c8640 0x7f59bc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0c4360 con 0x7f59bc0c6310 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0c96d0 con 0x7f59bc071e70 2024-01-27T14:59:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59c0ae5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1ef250 con 0x7f59bc0c8640 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 0x7f59bc1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59ba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59bad9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59bc0c8640 0x7f59bc156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59ba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48920/0 (socket says 172.21.15.46:48920) 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.356+0000 7f59b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 0x7f59bc1599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48004/0 (socket says 172.21.15.46:48004) 2024-01-27T14:59:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.357+0000 7f59ba59c640 1 -- 172.21.15.46:0/1073796288 learned_addr learned my addr 172.21.15.46:0/1073796288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.360+0000 7f59ba59c640 1 -- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59bc0c8640 msgr2=0x7f59bc156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.360+0000 7f59ba59c640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59bc0c8640 0x7f59bc156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.360+0000 7f59ba59c640 1 -- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 msgr2=0x7f59bc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.360+0000 7f59ba59c640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 0x7f59bc1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.360+0000 7f59ba59c640 1 -- 172.21.15.46:0/1073796288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac00a670 con 0x7f59bc071e70 2024-01-27T14:59:33.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.362+0000 7f59ba59c640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f59ac02cf50 tx=0x7f59ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.366+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03f600 con 0x7f59bc071e70 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.366+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac03f760 con 0x7f59bc071e70 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.366+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03fb10 con 0x7f59bc071e70 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.366+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc0c3350 con 0x7f59bc071e70 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.366+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc0b0310 con 0x7f59bc071e70 2024-01-27T14:59:33.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.367+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc1534e0 con 0x7f59bc071e70 2024-01-27T14:59:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.609+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f59ac03fc70 con 0x7f59bc071e70 2024-01-27T14:59:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.609+0000 7f59b2ffd640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 0x7f599c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.609+0000 7f59b3fff640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 0x7f599c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.610+0000 7f59b3fff640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 0x7f599c06d3e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59bc155f70 tx=0x7f59a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.612+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f59ac07af20 con 0x7f59bc071e70 2024-01-27T14:59:33.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.622+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f59ac077260 con 0x7f59bc071e70 2024-01-27T14:59:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.805+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59bc1534e0 con 0x7f59bc071e70 2024-01-27T14:59:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.810+0000 7f59b2ffd640 1 -- 172.21.15.46:0/1073796288 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59bc1534e0 con 0x7f59bc071e70 2024-01-27T14:59:33.813 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.812+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 msgr2=0x7f599c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.812+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 0x7f599c06d3e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59bc155f70 tx=0x7f59a4009040 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.812+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 msgr2=0x7f59bc1eed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.812+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f59ac02cf50 tx=0x7f59ac004730 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 shutdown_connections 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f599c06af20 0x7f599c06d3e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59bc0c8640 0x7f59bc156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59bc0c6310 0x7f59bc1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 --2- 172.21.15.46:0/1073796288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc071e70 0x7f59bc1eed10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 >> 172.21.15.46:0/1073796288 conn(0x7f59bc0c7a00 msgr2=0x7f59bc072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:33.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 shutdown_connections 2024-01-27T14:59:33.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.813+0000 7f59c0ae5640 1 -- 172.21.15.46:0/1073796288 wait complete. 2024-01-27T14:59:33.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:59:33.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.929+0000 7fbd02761640 1 Processor -- start 2024-01-27T14:59:33.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.929+0000 7fbd02761640 1 -- start start 2024-01-27T14:59:33.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.930+0000 7fbd02761640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbcfc153c00 0x7fbcfc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.930+0000 7fbd02761640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.930+0000 7fbd02761640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0c4f40 con 0x7fbcfc0c9950 2024-01-27T14:59:33.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.930+0000 7fbd02761640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc15a7a0 con 0x7fbcfc153c00 2024-01-27T14:59:33.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.930+0000 7fbd02761640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc0b2f40 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.931+0000 7fbd00cfe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.931+0000 7fbcfbfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbcfc153c00 0x7fbcfc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.931+0000 7fbd00cfe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48924/0 (socket says 172.21.15.46:48924) 2024-01-27T14:59:33.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.931+0000 7fbd00cfe640 1 -- 172.21.15.46:0/2745859522 learned_addr learned my addr 172.21.15.46:0/2745859522 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:33.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.933+0000 7fbd00cfe640 1 -- 172.21.15.46:0/2745859522 >> v2:172.21.15.46:3300/0 conn(0x7fbcfc153c00 msgr2=0x7fbcfc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:33.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.933+0000 7fbd00cfe640 1 --2- 172.21.15.46:0/2745859522 >> v2:172.21.15.46:3300/0 conn(0x7fbcfc153c00 0x7fbcfc15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.933+0000 7fbd00cfe640 1 -- 172.21.15.46:0/2745859522 >> v1:172.21.15.46:6789/0 conn(0x7fbcfc0c9950 legacy=0x7fbcfc0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.933+0000 7fbd00cfe640 1 -- 172.21.15.46:0/2745859522 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc0c4070 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.935+0000 7fbd00cfe640 1 --2- 172.21.15.46:0/2745859522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc1573d0 tx=0x7fbcf402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d52d56b3d52114 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.939+0000 7fbcfaffd640 1 -- 172.21.15.46:0/2745859522 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf402cb20 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.939+0000 7fbcfaffd640 1 -- 172.21.15.46:0/2745859522 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf402cc80 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.939+0000 7fbcfaffd640 1 -- 172.21.15.46:0/2745859522 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40343f0 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 -- 172.21.15.46:0/2745859522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 msgr2=0x7fbcfc0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 --2- 172.21.15.46:0/2745859522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc1573d0 tx=0x7fbcf402bf80 comp rx=0 tx=0).stop 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 -- 172.21.15.46:0/2745859522 shutdown_connections 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 --2- 172.21.15.46:0/2745859522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc0b2a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 --2- 172.21.15.46:0/2745859522 >> v2:172.21.15.46:3300/0 conn(0x7fbcfc153c00 0x7fbcfc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 -- 172.21.15.46:0/2745859522 >> 172.21.15.46:0/2745859522 conn(0x7fbcfc06cca0 msgr2=0x7fbcfc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:33.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 -- 172.21.15.46:0/2745859522 shutdown_connections 2024-01-27T14:59:33.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.940+0000 7fbd02761640 1 -- 172.21.15.46:0/2745859522 wait complete. 2024-01-27T14:59:33.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.941+0000 7fbd02761640 1 Processor -- start 2024-01-27T14:59:33.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.941+0000 7fbd02761640 1 -- start start 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcfc0c9950 0x7fbcfc1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbcfc153c00 0x7fbcfc1efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1ef900 con 0x7fbcfc0c9950 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0cb1b0 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.942+0000 7fbd02761640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1f3880 con 0x7fbcfc153c00 2024-01-27T14:59:33.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.943+0000 7fbcfbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.943+0000 7fbcfb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcfc0c9950 0x7fbcfc1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.943+0000 7fbd00cfe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbcfc153c00 0x7fbcfc1efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.943+0000 7fbcfbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:48936/0 (socket says 172.21.15.46:48936) 2024-01-27T14:59:33.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.943+0000 7fbcfbfff640 1 -- 172.21.15.46:0/1098333493 learned_addr learned my addr 172.21.15.46:0/1098333493 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.947+0000 7fbcfbfff640 1 -- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbcfc153c00 msgr2=0x7fbcfc1efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.947+0000 7fbcfbfff640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbcfc153c00 0x7fbcfc1efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.947+0000 7fbcfbfff640 1 -- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcfc0c9950 msgr2=0x7fbcfc1f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.947+0000 7fbcfbfff640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcfc0c9950 0x7fbcfc1f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.947+0000 7fbcfbfff640 1 -- 172.21.15.46:0/1098333493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4009b30 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.950+0000 7fbcfbfff640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00e9b0 tx=0x7fbcec00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.953+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec009670 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.954+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00c9a0 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.954+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00cd50 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.954+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc0ca910 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.954+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc0caed0 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.955+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc0b5230 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.972+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbcec013470 con 0x7fbcfc0b25b0 2024-01-27T14:59:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.973+0000 7fbcf8ff9640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 0x7fbce806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.973+0000 7fbcfb7fe640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 0x7fbce806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.973+0000 7fbcfb7fe640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 0x7fbce806d3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc151670 tx=0x7fbcf0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:33.975+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fbcec058c50 con 0x7fbcfc0b25b0 2024-01-27T14:59:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.217+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbcec054f90 con 0x7fbcfc0b25b0 2024-01-27T14:59:34.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.438+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbcfc0742e0 con 0x7fbcfc0b25b0 2024-01-27T14:59:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.443+0000 7fbcf8ff9640 1 -- 172.21.15.46:0/1098333493 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbcec0210a0 con 0x7fbcfc0b25b0 2024-01-27T14:59:34.445 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 msgr2=0x7fbce806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 0x7fbce806d3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc151670 tx=0x7fbcf0009040 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 msgr2=0x7fbcfc14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00e9b0 tx=0x7fbcec00ee70 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 shutdown_connections 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fbce806af20 0x7fbce806d3e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbcfc153c00 0x7fbcfc1efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcfc0c9950 0x7fbcfc1f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 --2- 172.21.15.46:0/1098333493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcfc0b25b0 0x7fbcfc14b040 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.444+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 >> 172.21.15.46:0/1098333493 conn(0x7fbcfc06cca0 msgr2=0x7fbcfc14e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.445+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 shutdown_connections 2024-01-27T14:59:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.445+0000 7fbd02761640 1 -- 172.21.15.46:0/1098333493 wait complete. 2024-01-27T14:59:34.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:59:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 Processor -- start 2024-01-27T14:59:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 -- start start 2024-01-27T14:59:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae0150d50 con 0x7f7ae0156580 2024-01-27T14:59:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00c0fa0 con 0x7f7ae0150970 2024-01-27T14:59:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.559+0000 7f7ae6de5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00c1e80 con 0x7f7ae00c8630 2024-01-27T14:59:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.560+0000 7f7ae5382640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7ae0156580 0x7f7ae0160e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38066/0 (socket says 172.21.15.46:38066) 2024-01-27T14:59:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.560+0000 7f7ae5382640 1 -- 172.21.15.46:0/1422762871 learned_addr learned my addr 172.21.15.46:0/1422762871 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.560+0000 7f7adffff640 1 --2- 172.21.15.46:0/1422762871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886809202 0 0) 0x7f7ad8001490 con 0x7f7ae0156580 2024-01-27T14:59:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad0003520 con 0x7f7ae0156580 2024-01-27T14:59:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235507144 0 0) 0x7f7ae00c0fa0 con 0x7f7ae0150970 2024-01-27T14:59:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad8001490 con 0x7f7ae0150970 2024-01-27T14:59:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adffff640 1 -- 172.21.15.46:0/1422762871 >> v1:172.21.15.73:6789/0 conn(0x7f7ae0150970 legacy=0x7f7ae00c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adffff640 1 -- 172.21.15.46:0/1422762871 >> v1:172.21.15.46:6789/0 conn(0x7f7ae0156580 legacy=0x7f7ae0160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.563+0000 7f7adffff640 1 -- 172.21.15.46:0/1422762871 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00c1200 con 0x7f7ae00c8630 2024-01-27T14:59:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.565+0000 7f7adffff640 1 --2- 172.21.15.46:0/1422762871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae006d8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0097d0 tx=0x7f7acc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c98b69b89981316 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.568+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc030880 con 0x7f7ae00c8630 2024-01-27T14:59:34.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.569+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc0309e0 con 0x7f7ae00c8630 2024-01-27T14:59:34.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.569+0000 7f7adf7fe640 1 -- 172.21.15.46:0/1422762871 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc030d50 con 0x7f7ae00c8630 2024-01-27T14:59:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 -- 172.21.15.46:0/1422762871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 msgr2=0x7f7ae006d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/1422762871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae006d8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0097d0 tx=0x7f7acc02b9c0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 -- 172.21.15.46:0/1422762871 shutdown_connections 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/1422762871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae006d8b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 -- 172.21.15.46:0/1422762871 >> 172.21.15.46:0/1422762871 conn(0x7f7ae00cbf80 msgr2=0x7f7ae00cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 -- 172.21.15.46:0/1422762871 shutdown_connections 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.570+0000 7f7ae6de5640 1 -- 172.21.15.46:0/1422762871 wait complete. 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.571+0000 7f7ae6de5640 1 Processor -- start 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.571+0000 7f7ae6de5640 1 -- start start 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae01eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae0156580 0x7f7ae01de1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01de730 con 0x7f7ae0150970 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00cb3f0 con 0x7f7ae0156580 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.572+0000 7f7ae6de5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01dce70 con 0x7f7ae00c8630 2024-01-27T14:59:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.573+0000 7f7adffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.573+0000 7f7ae5382640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae0156580 0x7f7ae01de1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.573+0000 7f7ae4b81640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae01eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.573+0000 7f7adffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37398/0 (socket says 172.21.15.46:37398) 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.573+0000 7f7adffff640 1 -- 172.21.15.46:0/2440241934 learned_addr learned my addr 172.21.15.46:0/2440241934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.577+0000 7f7adffff640 1 -- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 msgr2=0x7f7ae01eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.577+0000 7f7adffff640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae01eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.577+0000 7f7adffff640 1 -- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae0156580 msgr2=0x7f7ae01de1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.577+0000 7f7adffff640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae0156580 0x7f7ae01de1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.577+0000 7f7adffff640 1 -- 172.21.15.46:0/2440241934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009400 con 0x7f7ae0150970 2024-01-27T14:59:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.579+0000 7f7adffff640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098f0 tx=0x7f7acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.583+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc03e070 con 0x7f7ae0150970 2024-01-27T14:59:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.583+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc003610 con 0x7f7ae0150970 2024-01-27T14:59:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.583+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae01dd150 con 0x7f7ae0150970 2024-01-27T14:59:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.583+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc003980 con 0x7f7ae0150970 2024-01-27T14:59:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.583+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae01dd710 con 0x7f7ae0150970 2024-01-27T14:59:34.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.584+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae00c7af0 con 0x7f7ae0150970 2024-01-27T14:59:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.604+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7acc003ae0 con 0x7f7ae0150970 2024-01-27T14:59:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.604+0000 7f7add7fa640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 0x7f7ac406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.604+0000 7f7ae4b81640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 0x7f7ac406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.605+0000 7f7ae4b81640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 0x7f7ac406d3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4007fd0 tx=0x7f7ad4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.608+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7acc07aa40 con 0x7f7ae0150970 2024-01-27T14:59:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:34.867+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7acc076d80 con 0x7f7ae0150970 2024-01-27T14:59:35.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.074+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ae00742e0 con 0x7f7ae0150970 2024-01-27T14:59:35.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.079+0000 7f7add7fa640 1 -- 172.21.15.46:0/2440241934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7acc050080 con 0x7f7ae0150970 2024-01-27T14:59:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 msgr2=0x7f7ac406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 0x7f7ac406d3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4007fd0 tx=0x7f7ad4009040 comp rx=0 tx=0).stop 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 msgr2=0x7f7ae00c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098f0 tx=0x7f7acc0046c0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 shutdown_connections 2024-01-27T14:59:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ac406af20 0x7f7ac406d3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae0156580 0x7f7ae01de1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0150970 0x7f7ae00c3620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 --2- 172.21.15.46:0/2440241934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ae00c8630 0x7f7ae01eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 >> 172.21.15.46:0/2440241934 conn(0x7f7ae00cbf80 msgr2=0x7f7ae0154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 shutdown_connections 2024-01-27T14:59:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.081+0000 7f7ae6de5640 1 -- 172.21.15.46:0/2440241934 wait complete. 2024-01-27T14:59:35.095 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:59:35.095 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:59:35.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:59:35.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.251+0000 7f66418bb640 1 Processor -- start 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.251+0000 7f66418bb640 1 -- start start 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f66418bb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f663c153b00 0x7f663c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f66418bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f663c0cf2c0 0x7f663c0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f66418bb640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0b3280 con 0x7f663c0ca600 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f66418bb640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c15a8a0 con 0x7f663c153b00 2024-01-27T14:59:35.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f66418bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0caa10 con 0x7f663c0cf2c0 2024-01-27T14:59:35.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f663affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f663c153b00 0x7f663c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.252+0000 7f663a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f663c0cf2c0 0x7f663c0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.253+0000 7f663a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f663c0cf2c0 0x7f663c0ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52264/0 (socket says 172.21.15.46:52264) 2024-01-27T14:59:35.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.253+0000 7f663a7fc640 1 -- 172.21.15.46:0/2980166743 learned_addr learned my addr 172.21.15.46:0/2980166743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.255+0000 7f663a7fc640 1 -- 172.21.15.46:0/2980166743 >> v2:172.21.15.46:3300/0 conn(0x7f663c153b00 msgr2=0x7f663c0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.255+0000 7f663a7fc640 1 --2- 172.21.15.46:0/2980166743 >> v2:172.21.15.46:3300/0 conn(0x7f663c153b00 0x7f663c0cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.255+0000 7f663a7fc640 1 -- 172.21.15.46:0/2980166743 >> v1:172.21.15.46:6789/0 conn(0x7f663c0ca600 legacy=0x7f663c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.255+0000 7f663a7fc640 1 -- 172.21.15.46:0/2980166743 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c15d0d0 con 0x7f663c0cf2c0 2024-01-27T14:59:35.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.259+0000 7f663a7fc640 1 --2- 172.21.15.46:0/2980166743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0cf2c0 0x7f663c0ca0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa60027e6114305 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.263+0000 7f6639ffb640 1 -- 172.21.15.46:0/2980166743 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662402f840 con 0x7f663c0cf2c0 2024-01-27T14:59:35.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.263+0000 7f6639ffb640 1 -- 172.21.15.46:0/2980166743 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662402f9a0 con 0x7f663c0cf2c0 2024-01-27T14:59:35.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.263+0000 7f6639ffb640 1 -- 172.21.15.46:0/2980166743 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662402fd30 con 0x7f663c0cf2c0 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 -- 172.21.15.46:0/2980166743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0cf2c0 msgr2=0x7f663c0ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 --2- 172.21.15.46:0/2980166743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0cf2c0 0x7f663c0ca0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662402ba20 comp rx=0 tx=0).stop 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 -- 172.21.15.46:0/2980166743 shutdown_connections 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 --2- 172.21.15.46:0/2980166743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0cf2c0 0x7f663c0ca0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 --2- 172.21.15.46:0/2980166743 >> v2:172.21.15.46:3300/0 conn(0x7f663c153b00 0x7f663c0cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 -- 172.21.15.46:0/2980166743 >> 172.21.15.46:0/2980166743 conn(0x7f663c08b190 msgr2=0x7f663c08b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 -- 172.21.15.46:0/2980166743 shutdown_connections 2024-01-27T14:59:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.264+0000 7f66418bb640 1 -- 172.21.15.46:0/2980166743 wait complete. 2024-01-27T14:59:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.265+0000 7f66418bb640 1 Processor -- start 2024-01-27T14:59:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.265+0000 7f66418bb640 1 -- start start 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f663c0cf2c0 0x7f663c1e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c153b00 0x7f663c0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1e4bc0 con 0x7f663c153b00 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c14ea20 con 0x7f663c0ca600 2024-01-27T14:59:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.266+0000 7f66418bb640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c15c600 con 0x7f663c0cf2c0 2024-01-27T14:59:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.267+0000 7f663affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.267+0000 7f663a7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f663c0cf2c0 0x7f663c1e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.267+0000 7f663affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52272/0 (socket says 172.21.15.46:52272) 2024-01-27T14:59:35.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.267+0000 7f663affd640 1 -- 172.21.15.46:0/3806676367 learned_addr learned my addr 172.21.15.46:0/3806676367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.270+0000 7f663affd640 1 -- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f663c0cf2c0 msgr2=0x7f663c1e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.270+0000 7f663affd640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f663c0cf2c0 0x7f663c1e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.270+0000 7f663affd640 1 -- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c153b00 msgr2=0x7f663c0c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.270+0000 7f663affd640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c153b00 0x7f663c0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.270+0000 7f663affd640 1 -- 172.21.15.46:0/3806676367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094d0 con 0x7f663c0ca600 2024-01-27T14:59:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.272+0000 7f663affd640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f663400e870 tx=0x7f663400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.276+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340094f0 con 0x7f663c0ca600 2024-01-27T14:59:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.276+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400c940 con 0x7f663c0ca600 2024-01-27T14:59:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.276+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400ccf0 con 0x7f663c0ca600 2024-01-27T14:59:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.276+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c15c830 con 0x7f663c0ca600 2024-01-27T14:59:35.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.276+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c1ef040 con 0x7f663c0ca600 2024-01-27T14:59:35.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.277+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0742e0 con 0x7f663c0ca600 2024-01-27T14:59:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.515+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6634013470 con 0x7f663c0ca600 2024-01-27T14:59:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.516+0000 7f6633fff640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 0x7f661c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.516+0000 7f663a7fc640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 0x7f661c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.516+0000 7f663a7fc640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 0x7f661c06d3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6624036000 tx=0x7f6624008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.519+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6634058a70 con 0x7f663c0ca600 2024-01-27T14:59:35.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.529+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6634054db0 con 0x7f663c0ca600 2024-01-27T14:59:35.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.713+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663c0cac90 con 0x7f663c0ca600 2024-01-27T14:59:35.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.752+0000 7f6633fff640 1 -- 172.21.15.46:0/3806676367 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f6634021020 con 0x7f663c0ca600 2024-01-27T14:59:35.755 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 msgr2=0x7f661c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 0x7f661c06d3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6624036000 tx=0x7f6624008030 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 msgr2=0x7f663c1e36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f663400e870 tx=0x7f663400ed30 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 shutdown_connections 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f661c06af20 0x7f661c06d3e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c153b00 0x7f663c0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f663c0cf2c0 0x7f663c1e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 --2- 172.21.15.46:0/3806676367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f663c0ca600 0x7f663c1e36a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.753+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 >> 172.21.15.46:0/3806676367 conn(0x7f663c08b190 msgr2=0x7f663c15b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:35.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.754+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 shutdown_connections 2024-01-27T14:59:35.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.754+0000 7f66418bb640 1 -- 172.21.15.46:0/3806676367 wait complete. 2024-01-27T14:59:35.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T14:31:29.304882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T14:31:49.122080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T14:31:50.280316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T14:31:55.515914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:59:35.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:59:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.871+0000 7fab4e090640 1 Processor -- start 2024-01-27T14:59:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.871+0000 7fab4e090640 1 -- start start 2024-01-27T14:59:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.872+0000 7fab4e090640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab480c8e60 0x7fab480c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.872+0000 7fab4e090640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fab480c5430 0x7fab48151170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.872+0000 7fab4e090640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48157ef0 con 0x7fab480c5050 2024-01-27T14:59:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.872+0000 7fab4e090640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806b860 con 0x7fab480c5430 2024-01-27T14:59:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.872+0000 7fab4e090640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806bb00 con 0x7fab480c8e60 2024-01-27T14:59:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.873+0000 7fab47fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fab480c5430 0x7fab48151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.873+0000 7fab47fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fab480c5430 0x7fab48151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37414/0 (socket says 172.21.15.46:37414) 2024-01-27T14:59:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.873+0000 7fab47fff640 1 -- 172.21.15.46:0/1006314147 learned_addr learned my addr 172.21.15.46:0/1006314147 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.873+0000 7fab46ffd640 1 --2- 172.21.15.46:0/1006314147 >> v2:172.21.15.73:3300/0 conn(0x7fab480c8e60 0x7fab480c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.875+0000 7fab47fff640 1 -- 172.21.15.46:0/1006314147 >> v2:172.21.15.73:3300/0 conn(0x7fab480c8e60 msgr2=0x7fab480c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.875+0000 7fab47fff640 1 --2- 172.21.15.46:0/1006314147 >> v2:172.21.15.73:3300/0 conn(0x7fab480c8e60 0x7fab480c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.875+0000 7fab47fff640 1 -- 172.21.15.46:0/1006314147 >> v1:172.21.15.73:6789/0 conn(0x7fab480c5050 legacy=0x7fab4815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.875+0000 7fab47fff640 1 -- 172.21.15.46:0/1006314147 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48158140 con 0x7fab480c5430 2024-01-27T14:59:35.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.877+0000 7fab47fff640 1 --2- 172.21.15.46:0/1006314147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab48151170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab481550a0 tx=0x7fab4002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e93df652247596 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.881+0000 7fab467fc640 1 -- 172.21.15.46:0/1006314147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4002ca80 con 0x7fab480c5430 2024-01-27T14:59:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.881+0000 7fab467fc640 1 -- 172.21.15.46:0/1006314147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4002cbe0 con 0x7fab480c5430 2024-01-27T14:59:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.881+0000 7fab467fc640 1 -- 172.21.15.46:0/1006314147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400343f0 con 0x7fab480c5430 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 -- 172.21.15.46:0/1006314147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 msgr2=0x7fab48151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 --2- 172.21.15.46:0/1006314147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab48151170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab481550a0 tx=0x7fab4002bee0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 -- 172.21.15.46:0/1006314147 shutdown_connections 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 --2- 172.21.15.46:0/1006314147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab48151170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 --2- 172.21.15.46:0/1006314147 >> v2:172.21.15.73:3300/0 conn(0x7fab480c8e60 0x7fab480c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 -- 172.21.15.46:0/1006314147 >> 172.21.15.46:0/1006314147 conn(0x7fab480cbd00 msgr2=0x7fab480c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 -- 172.21.15.46:0/1006314147 shutdown_connections 2024-01-27T14:59:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.882+0000 7fab4e090640 1 -- 172.21.15.46:0/1006314147 wait complete. 2024-01-27T14:59:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.883+0000 7fab4e090640 1 Processor -- start 2024-01-27T14:59:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.883+0000 7fab4e090640 1 -- start start 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 0x7fab4814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab481f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab480c8e60 0x7fab481f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab481458f0 con 0x7fab480c5430 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48146bb0 con 0x7fab480c5050 2024-01-27T14:59:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab4e090640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab481eeec0 con 0x7fab480c8e60 2024-01-27T14:59:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.884+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab481f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.885+0000 7fab477fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 0x7fab4814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.885+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab481f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37422/0 (socket says 172.21.15.46:37422) 2024-01-27T14:59:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.885+0000 7fab46ffd640 1 -- 172.21.15.46:0/1063709684 learned_addr learned my addr 172.21.15.46:0/1063709684 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.885+0000 7fab47fff640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab480c8e60 0x7fab481f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.888+0000 7fab477fe640 1 -- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab480c8e60 msgr2=0x7fab481f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.888+0000 7fab477fe640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab480c8e60 0x7fab481f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.888+0000 7fab477fe640 1 -- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 msgr2=0x7fab481f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.888+0000 7fab477fe640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab481f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.888+0000 7fab477fe640 1 -- 172.21.15.46:0/1063709684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009b30 con 0x7fab480c5050 2024-01-27T14:59:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.890+0000 7fab477fe640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 0x7fab4814e8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c3f0 tx=0x7fab3800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380052d0 con 0x7fab480c5050 2024-01-27T14:59:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38005450 con 0x7fab480c5050 2024-01-27T14:59:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38007260 con 0x7fab480c5050 2024-01-27T14:59:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab481ef1a0 con 0x7fab480c5050 2024-01-27T14:59:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab481ef760 con 0x7fab480c5050 2024-01-27T14:59:35.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.895+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48067c70 con 0x7fab480c5050 2024-01-27T14:59:35.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.914+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fab380073c0 con 0x7fab480c5050 2024-01-27T14:59:35.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.914+0000 7fab2ffff640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 0x7fab3406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:35.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.914+0000 7fab46ffd640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 0x7fab3406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:35.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.915+0000 7fab46ffd640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 0x7fab3406d3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fab481ec7a0 tx=0x7fab3c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:35.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:35.917+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fab380579d0 con 0x7fab480c5050 2024-01-27T14:59:36.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.154+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fab38053d10 con 0x7fab480c5050 2024-01-27T14:59:36.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.332+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab4806fc70 con 0x7fab480c5050 2024-01-27T14:59:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.339+0000 7fab2ffff640 1 -- 172.21.15.46:0/1063709684 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab38020070 con 0x7fab480c5050 2024-01-27T14:59:36.341 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:59:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 msgr2=0x7fab3406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 0x7fab3406d3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fab481ec7a0 tx=0x7fab3c009190 comp rx=0 tx=0).stop 2024-01-27T14:59:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 msgr2=0x7fab4814e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 0x7fab4814e8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c3f0 tx=0x7fab3800c8b0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 shutdown_connections 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fab3406af20 0x7fab3406d3e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab480c8e60 0x7fab481f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab480c5430 0x7fab481f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 --2- 172.21.15.46:0/1063709684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab480c5050 0x7fab4814e8a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 >> 172.21.15.46:0/1063709684 conn(0x7fab480cbd00 msgr2=0x7fab481574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 shutdown_connections 2024-01-27T14:59:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.340+0000 7fab4e090640 1 -- 172.21.15.46:0/1063709684 wait complete. 2024-01-27T14:59:36.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:59:36.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.455+0000 7f9c701ec640 1 Processor -- start 2024-01-27T14:59:36.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.455+0000 7f9c701ec640 1 -- start start 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.456+0000 7f9c701ec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 0x7f9c680cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.456+0000 7f9c701ec640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680c2c10 con 0x7f9c6806b620 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.456+0000 7f9c701ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680c2ed0 con 0x7f9c68153b30 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.456+0000 7f9c701ec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6806ba20 con 0x7f9c6815a230 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.457+0000 7f9c6d787640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c6806b620 0x7f9c680c7440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38074/0 (socket says 172.21.15.46:38074) 2024-01-27T14:59:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.457+0000 7f9c6df88640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9c68153b30 0x7f9c680c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:53062/0 (socket says 172.21.15.46:53062) 2024-01-27T14:59:36.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.457+0000 7f9c6d787640 1 -- 172.21.15.46:0/3974742633 learned_addr learned my addr 172.21.15.46:0/3974742633 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:36.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.457+0000 7f9c6e789640 1 --2- 172.21.15.46:0/3974742633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 0x7f9c680cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:36.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.458+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871771420 0 0) 0x7f9c680c2ed0 con 0x7f9c68153b30 2024-01-27T14:59:36.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.458+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c50003520 con 0x7f9c68153b30 2024-01-27T14:59:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.459+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103572209 0 0) 0x7f9c680c2c10 con 0x7f9c6806b620 2024-01-27T14:59:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.459+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c680c2ed0 con 0x7f9c6806b620 2024-01-27T14:59:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.459+0000 7f9c6e789640 1 -- 172.21.15.46:0/3974742633 >> v1:172.21.15.73:6789/0 conn(0x7f9c68153b30 legacy=0x7f9c680c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.459+0000 7f9c6e789640 1 -- 172.21.15.46:0/3974742633 >> v1:172.21.15.46:6789/0 conn(0x7f9c6806b620 legacy=0x7f9c680c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.459+0000 7f9c6e789640 1 -- 172.21.15.46:0/3974742633 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68159750 con 0x7f9c6815a230 2024-01-27T14:59:36.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.461+0000 7f9c6e789640 1 --2- 172.21.15.46:0/3974742633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 0x7f9c680cbfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009dc0 tx=0x7f9c5802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3c01439201ae84 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:36.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.465+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5802cd50 con 0x7f9c6815a230 2024-01-27T14:59:36.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.465+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58034440 con 0x7f9c6815a230 2024-01-27T14:59:36.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.465+0000 7f9c6cf86640 1 -- 172.21.15.46:0/3974742633 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c580347d0 con 0x7f9c6815a230 2024-01-27T14:59:36.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 -- 172.21.15.46:0/3974742633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 msgr2=0x7f9c680cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 --2- 172.21.15.46:0/3974742633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 0x7f9c680cbfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009dc0 tx=0x7f9c5802bfa0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 -- 172.21.15.46:0/3974742633 shutdown_connections 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 --2- 172.21.15.46:0/3974742633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6815a230 0x7f9c680cbfd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 -- 172.21.15.46:0/3974742633 >> 172.21.15.46:0/3974742633 conn(0x7f9c6806e1a0 msgr2=0x7f9c6806e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 -- 172.21.15.46:0/3974742633 shutdown_connections 2024-01-27T14:59:36.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.466+0000 7f9c701ec640 1 -- 172.21.15.46:0/3974742633 wait complete. 2024-01-27T14:59:36.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.467+0000 7f9c701ec640 1 Processor -- start 2024-01-27T14:59:36.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.467+0000 7f9c701ec640 1 -- start start 2024-01-27T14:59:36.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 0x7f9c681f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c6815a230 0x7f9c6814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6815a6c0 con 0x7f9c6815a230 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680c40d0 con 0x7f9c68153b30 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c701ec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68155550 con 0x7f9c6806b620 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.468+0000 7f9c6e789640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c6815a230 0x7f9c6814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.469+0000 7f9c6d787640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.469+0000 7f9c6df88640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 0x7f9c681f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.469+0000 7f9c6d787640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52308/0 (socket says 172.21.15.46:52308) 2024-01-27T14:59:36.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.469+0000 7f9c6d787640 1 -- 172.21.15.46:0/2779373181 learned_addr learned my addr 172.21.15.46:0/2779373181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:36.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6d787640 1 -- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 msgr2=0x7f9c681f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6d787640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 0x7f9c681f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6d787640 1 -- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c6815a230 msgr2=0x7f9c6814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6d787640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c6815a230 0x7f9c6814c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6d787640 1 -- 172.21.15.46:0/2779373181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c58009a70 con 0x7f9c68153b30 2024-01-27T14:59:36.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.472+0000 7f9c6df88640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 0x7f9c681f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:59:36.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.475+0000 7f9c6d787640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c430 tx=0x7f9c5c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.478+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c005ce0 con 0x7f9c68153b30 2024-01-27T14:59:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.478+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c005e40 con 0x7f9c68153b30 2024-01-27T14:59:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.478+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0072f0 con 0x7f9c68153b30 2024-01-27T14:59:36.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.478+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c68155830 con 0x7f9c68153b30 2024-01-27T14:59:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.478+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c681f0b90 con 0x7f9c68153b30 2024-01-27T14:59:36.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.479+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c68067c70 con 0x7f9c68153b30 2024-01-27T14:59:36.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.497+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9c5c007450 con 0x7f9c68153b30 2024-01-27T14:59:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.498+0000 7f9c667fc640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 0x7f9c5406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.498+0000 7f9c6df88640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 0x7f9c5406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.498+0000 7f9c6df88640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 0x7f9c5406d410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:36.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.500+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9c5c057d10 con 0x7f9c68153b30 2024-01-27T14:59:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.732+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9c5c054050 con 0x7f9c68153b30 2024-01-27T14:59:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.917+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c680742e0 con 0x7f9c68153b30 2024-01-27T14:59:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.923+0000 7f9c667fc640 1 -- 172.21.15.46:0/2779373181 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c5c017020 con 0x7f9c68153b30 2024-01-27T14:59:36.925 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 msgr2=0x7f9c5406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 0x7f9c5406d410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60007d50 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 msgr2=0x7f9c681f18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c430 tx=0x7f9c5c00c8f0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 shutdown_connections 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c5406af50 0x7f9c5406d410 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c68153b30 0x7f9c681f18d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c6815a230 0x7f9c6814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 --2- 172.21.15.46:0/2779373181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6806b620 0x7f9c681f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 >> 172.21.15.46:0/2779373181 conn(0x7f9c6806e1a0 msgr2=0x7f9c68157280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:36.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 shutdown_connections 2024-01-27T14:59:36.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:36.924+0000 7f9c701ec640 1 -- 172.21.15.46:0/2779373181 wait complete. 2024-01-27T14:59:36.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:59:37.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.039+0000 7f985f78a640 1 Processor -- start 2024-01-27T14:59:37.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.039+0000 7f985f78a640 1 -- start start 2024-01-27T14:59:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.040+0000 7f985f78a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9858153a20 0x7f98580ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.040+0000 7f985f78a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98580cc490 0x7f98580ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.040+0000 7f985f78a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985806bed0 con 0x7f985815a3c0 2024-01-27T14:59:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.040+0000 7f985f78a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985806cdc0 con 0x7f98580cc490 2024-01-27T14:59:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.040+0000 7f985f78a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985806c1b0 con 0x7f9858153a20 2024-01-27T14:59:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.041+0000 7f985d526640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9858153a20 0x7f98580ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.041+0000 7f985dd27640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98580cc490 0x7f98580ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.041+0000 7f985d526640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9858153a20 0x7f98580ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52320/0 (socket says 172.21.15.46:52320) 2024-01-27T14:59:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.041+0000 7f985d526640 1 -- 172.21.15.46:0/3014572794 learned_addr learned my addr 172.21.15.46:0/3014572794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:37.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.043+0000 7f985d526640 1 -- 172.21.15.46:0/3014572794 >> v2:172.21.15.46:3300/0 conn(0x7f98580cc490 msgr2=0x7f98580ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:37.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.043+0000 7f985d526640 1 --2- 172.21.15.46:0/3014572794 >> v2:172.21.15.46:3300/0 conn(0x7f98580cc490 0x7f98580ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.043+0000 7f985d526640 1 -- 172.21.15.46:0/3014572794 >> v1:172.21.15.46:6789/0 conn(0x7f985815a3c0 legacy=0x7f98580cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.043+0000 7f985d526640 1 -- 172.21.15.46:0/3014572794 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985806c490 con 0x7f9858153a20 2024-01-27T14:59:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.045+0000 7f985d526640 1 --2- 172.21.15.46:0/3014572794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580ca050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f985808cb60 tx=0x7f985002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea7d1483c9e0d56 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f9857fff640 1 -- 172.21.15.46:0/3014572794 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985002f850 con 0x7f9858153a20 2024-01-27T14:59:37.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f9857fff640 1 -- 172.21.15.46:0/3014572794 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985002f9b0 con 0x7f9858153a20 2024-01-27T14:59:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f9857fff640 1 -- 172.21.15.46:0/3014572794 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985002fd40 con 0x7f9858153a20 2024-01-27T14:59:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 -- 172.21.15.46:0/3014572794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 msgr2=0x7f98580ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 --2- 172.21.15.46:0/3014572794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580ca050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f985808cb60 tx=0x7f985002ba30 comp rx=0 tx=0).stop 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 -- 172.21.15.46:0/3014572794 shutdown_connections 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 --2- 172.21.15.46:0/3014572794 >> v2:172.21.15.46:3300/0 conn(0x7f98580cc490 0x7f98580ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 --2- 172.21.15.46:0/3014572794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580ca050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 -- 172.21.15.46:0/3014572794 >> 172.21.15.46:0/3014572794 conn(0x7f9858071fd0 msgr2=0x7f98580723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 -- 172.21.15.46:0/3014572794 shutdown_connections 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.049+0000 7f985f78a640 1 -- 172.21.15.46:0/3014572794 wait complete. 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.050+0000 7f985f78a640 1 Processor -- start 2024-01-27T14:59:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.050+0000 7f985f78a640 1 -- start start 2024-01-27T14:59:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98580cc490 0x7f98580c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f985815a3c0 0x7f985814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c8980 con 0x7f98580cc490 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985815db10 con 0x7f9858153a20 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.051+0000 7f985f78a640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98581f0360 con 0x7f985815a3c0 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.052+0000 7f985cd25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.052+0000 7f985d526640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98580cc490 0x7f98580c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.052+0000 7f985dd27640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f985815a3c0 0x7f985814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.052+0000 7f985cd25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52330/0 (socket says 172.21.15.46:52330) 2024-01-27T14:59:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.052+0000 7f985cd25640 1 -- 172.21.15.46:0/2198884877 learned_addr learned my addr 172.21.15.46:0/2198884877 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.055+0000 7f985cd25640 1 -- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f985815a3c0 msgr2=0x7f985814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.055+0000 7f985cd25640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f985815a3c0 0x7f985814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.055+0000 7f985cd25640 1 -- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98580cc490 msgr2=0x7f98580c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.055+0000 7f985cd25640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98580cc490 0x7f98580c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.055+0000 7f985cd25640 1 -- 172.21.15.46:0/2198884877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500094d0 con 0x7f9858153a20 2024-01-27T14:59:37.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.058+0000 7f985cd25640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c3c0 tx=0x7f984c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c0052d0 con 0x7f9858153a20 2024-01-27T14:59:37.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c005450 con 0x7f9858153a20 2024-01-27T14:59:37.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858153f80 con 0x7f9858153a20 2024-01-27T14:59:37.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c007260 con 0x7f9858153a20 2024-01-27T14:59:37.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98581ef750 con 0x7f9858153a20 2024-01-27T14:59:37.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.062+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98580742e0 con 0x7f9858153a20 2024-01-27T14:59:37.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.081+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f984c0073c0 con 0x7f9858153a20 2024-01-27T14:59:37.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.081+0000 7f9855ffb640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 0x7f984406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.082+0000 7f985d526640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 0x7f984406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.082+0000 7f985d526640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 0x7f984406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9850036000 tx=0x7f9850008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.310+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f984c057ae0 con 0x7f9858153a20 2024-01-27T14:59:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.319+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f984c053e20 con 0x7f9858153a20 2024-01-27T14:59:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.521+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98580b5250 con 0x7f9858153a20 2024-01-27T14:59:37.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.527+0000 7f9855ffb640 1 -- 172.21.15.46:0/2198884877 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f984c020020 con 0x7f9858153a20 2024-01-27T14:59:37.530 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 msgr2=0x7f984406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 0x7f984406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9850036000 tx=0x7f9850008030 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 msgr2=0x7f98580c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c3c0 tx=0x7f984c00c880 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 shutdown_connections 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f984406aed0 0x7f984406d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9858153a20 0x7f98580c5340 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f985815a3c0 0x7f985814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 --2- 172.21.15.46:0/2198884877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98580cc490 0x7f98580c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 >> 172.21.15.46:0/2198884877 conn(0x7f9858071fd0 msgr2=0x7f98580cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 shutdown_connections 2024-01-27T14:59:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.529+0000 7f985f78a640 1 -- 172.21.15.46:0/2198884877 wait complete. 2024-01-27T14:59:37.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:59:37.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.645+0000 7efc10f53640 1 Processor -- start 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.645+0000 7efc10f53640 1 -- start start 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.646+0000 7efc10f53640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc0c151810 0x7efc0c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.646+0000 7efc10f53640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 0x7efc0c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.646+0000 7efc10f53640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c15b9b0 con 0x7efc0c15b520 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.646+0000 7efc10f53640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c158500 con 0x7efc0c151810 2024-01-27T14:59:37.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.646+0000 7efc10f53640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c15aad0 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.647+0000 7efc09d9b640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 0x7efc0c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.647+0000 7efc0a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc0c151810 0x7efc0c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.647+0000 7efc0ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efc0c15b520 0x7efc0c070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:53078/0 (socket says 172.21.15.46:53078) 2024-01-27T14:59:37.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.647+0000 7efc0ad9d640 1 -- 172.21.15.46:0/2267004571 learned_addr learned my addr 172.21.15.46:0/2267004571 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.651+0000 7efc09d9b640 1 -- 172.21.15.46:0/2267004571 >> v2:172.21.15.73:3300/0 conn(0x7efc0c151810 msgr2=0x7efc0c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.651+0000 7efc09d9b640 1 --2- 172.21.15.46:0/2267004571 >> v2:172.21.15.73:3300/0 conn(0x7efc0c151810 0x7efc0c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.651+0000 7efc09d9b640 1 -- 172.21.15.46:0/2267004571 >> v1:172.21.15.73:6789/0 conn(0x7efc0c15b520 legacy=0x7efc0c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.651+0000 7efc09d9b640 1 -- 172.21.15.46:0/2267004571 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c15b090 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.653+0000 7efc09d9b640 1 --2- 172.21.15.46:0/2267004571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 0x7efc0c0c9380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097a0 tx=0x7efbf402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235e6057049505ba server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.657+0000 7efc0959a640 1 -- 172.21.15.46:0/2267004571 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4030610 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.657+0000 7efc0959a640 1 -- 172.21.15.46:0/2267004571 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4030770 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.657+0000 7efc0959a640 1 -- 172.21.15.46:0/2267004571 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4030b00 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- 172.21.15.46:0/2267004571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 msgr2=0x7efc0c0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 --2- 172.21.15.46:0/2267004571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 0x7efc0c0c9380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097a0 tx=0x7efbf402b960 comp rx=0 tx=0).stop 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- 172.21.15.46:0/2267004571 shutdown_connections 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 --2- 172.21.15.46:0/2267004571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c0ca3d0 0x7efc0c0c9380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 --2- 172.21.15.46:0/2267004571 >> v2:172.21.15.73:3300/0 conn(0x7efc0c151810 0x7efc0c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- 172.21.15.46:0/2267004571 >> 172.21.15.46:0/2267004571 conn(0x7efc0c066c80 msgr2=0x7efc0c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- 172.21.15.46:0/2267004571 shutdown_connections 2024-01-27T14:59:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- 172.21.15.46:0/2267004571 wait complete. 2024-01-27T14:59:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 Processor -- start 2024-01-27T14:59:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.658+0000 7efc10f53640 1 -- start start 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc0c0ca3d0 0x7efc0c14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c15b520 0x7efc0c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1564f0 con 0x7efc0c0ca3d0 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1540f0 con 0x7efc0c151810 2024-01-27T14:59:37.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc10f53640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1543d0 con 0x7efc0c15b520 2024-01-27T14:59:37.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc09d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc0a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc0c0ca3d0 0x7efc0c14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc0ad9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c15b520 0x7efc0c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc09d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:52346/0 (socket says 172.21.15.46:52346) 2024-01-27T14:59:37.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.659+0000 7efc09d9b640 1 -- 172.21.15.46:0/1539559098 learned_addr learned my addr 172.21.15.46:0/1539559098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.664+0000 7efc09d9b640 1 -- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c15b520 msgr2=0x7efc0c14bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.664+0000 7efc09d9b640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c15b520 0x7efc0c14bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.664+0000 7efc09d9b640 1 -- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc0c0ca3d0 msgr2=0x7efc0c14de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.664+0000 7efc09d9b640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc0c0ca3d0 0x7efc0c14de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.664+0000 7efc09d9b640 1 -- 172.21.15.46:0/1539559098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4009400 con 0x7efc0c151810 2024-01-27T14:59:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.665+0000 7efc09d9b640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098c0 tx=0x7efbf4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.669+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf403e040 con 0x7efc0c151810 2024-01-27T14:59:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.669+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4039cb0 con 0x7efc0c151810 2024-01-27T14:59:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.669+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4044630 con 0x7efc0c151810 2024-01-27T14:59:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.669+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c1546b0 con 0x7efc0c151810 2024-01-27T14:59:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.669+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c153df0 con 0x7efc0c151810 2024-01-27T14:59:37.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.670+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c1569f0 con 0x7efc0c151810 2024-01-27T14:59:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.912+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efbf404d3b0 con 0x7efc0c151810 2024-01-27T14:59:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.913+0000 7efc02ffd640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 0x7efbec06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.913+0000 7efc0a59c640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 0x7efbec06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.913+0000 7efc0a59c640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 0x7efbec06d3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc04009b40 tx=0x7efc04009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.916+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efbf4039e20 con 0x7efc0c151810 2024-01-27T14:59:37.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:37.925+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efbf4076f80 con 0x7efc0c151810 2024-01-27T14:59:38.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.107+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc0c0742e0 con 0x7efc0c151810 2024-01-27T14:59:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.113+0000 7efc02ffd640 1 -- 172.21.15.46:0/1539559098 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7efbf40340a0 con 0x7efc0c151810 2024-01-27T14:59:38.115 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:59:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 msgr2=0x7efbec06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 0x7efbec06d3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc04009b40 tx=0x7efc04009190 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 msgr2=0x7efc0c1520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098c0 tx=0x7efbf4004730 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 shutdown_connections 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7efbec06af20 0x7efbec06d3e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc0c151810 0x7efc0c1520e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc0c15b520 0x7efc0c14bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 --2- 172.21.15.46:0/1539559098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc0c0ca3d0 0x7efc0c14de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 >> 172.21.15.46:0/1539559098 conn(0x7efc0c066c80 msgr2=0x7efc0c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 shutdown_connections 2024-01-27T14:59:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.114+0000 7efc10f53640 1 -- 172.21.15.46:0/1539559098 wait complete. 2024-01-27T14:59:38.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:59:38.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.228+0000 7fe39582f640 1 Processor -- start 2024-01-27T14:59:38.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.228+0000 7fe39582f640 1 -- start start 2024-01-27T14:59:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.229+0000 7fe39582f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe390153cb0 0x7fe3900c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.229+0000 7fe39582f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900c2ef0 con 0x7fe39006ed90 2024-01-27T14:59:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.229+0000 7fe39582f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe390159a80 con 0x7fe39006b0d0 2024-01-27T14:59:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.229+0000 7fe39582f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe390154090 con 0x7fe390153cb0 2024-01-27T14:59:38.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.231+0000 7fe38effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe390153cb0 0x7fe3900c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:38.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.231+0000 7fe38e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe39006b0d0 0x7fe39006d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:53092/0 (socket says 172.21.15.46:53092) 2024-01-27T14:59:38.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.231+0000 7fe38e7fc640 1 -- 172.21.15.46:0/2587410813 learned_addr learned my addr 172.21.15.46:0/2587410813 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.232+0000 7fe38dffb640 1 -- 172.21.15.46:0/2587410813 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793697505 0 0) 0x7fe390159a80 con 0x7fe39006b0d0 2024-01-27T14:59:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.232+0000 7fe38dffb640 1 -- 172.21.15.46:0/2587410813 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c003520 con 0x7fe39006b0d0 2024-01-27T14:59:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.234+0000 7fe38effd640 1 -- 172.21.15.46:0/2587410813 >> v1:172.21.15.73:6789/0 conn(0x7fe39006b0d0 legacy=0x7fe39006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.234+0000 7fe38effd640 1 -- 172.21.15.46:0/2587410813 >> v1:172.21.15.46:6789/0 conn(0x7fe39006ed90 legacy=0x7fe3901641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.234+0000 7fe38effd640 1 -- 172.21.15.46:0/2587410813 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390159d60 con 0x7fe390153cb0 2024-01-27T14:59:38.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.235+0000 7fe38effd640 1 --2- 172.21.15.46:0/2587410813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe390153cb0 0x7fe3900c2640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eca246bb76d26 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:38.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.242+0000 7fe38dffb640 1 -- 172.21.15.46:0/2587410813 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38802f810 con 0x7fe390153cb0 2024-01-27T14:59:38.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.242+0000 7fe38dffb640 1 -- 172.21.15.46:0/2587410813 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38802f970 con 0x7fe390153cb0 2024-01-27T14:59:38.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.242+0000 7fe38dffb640 1 -- 172.21.15.46:0/2587410813 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38802fd00 con 0x7fe390153cb0 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 -- 172.21.15.46:0/2587410813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe390153cb0 msgr2=0x7fe3900c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 --2- 172.21.15.46:0/2587410813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe390153cb0 0x7fe3900c2640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802b9f0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 -- 172.21.15.46:0/2587410813 shutdown_connections 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 --2- 172.21.15.46:0/2587410813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe390153cb0 0x7fe3900c2640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 -- 172.21.15.46:0/2587410813 >> 172.21.15.46:0/2587410813 conn(0x7fe3900cbf80 msgr2=0x7fe3900cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 -- 172.21.15.46:0/2587410813 shutdown_connections 2024-01-27T14:59:38.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.243+0000 7fe39582f640 1 -- 172.21.15.46:0/2587410813 wait complete. 2024-01-27T14:59:38.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.244+0000 7fe39582f640 1 Processor -- start 2024-01-27T14:59:38.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.244+0000 7fe39582f640 1 -- start start 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe39006ed90 0x7fe3901e6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe390153cb0 0x7fe390142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900c6bb0 con 0x7fe39006b0d0 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3901ef990 con 0x7fe39006ed90 2024-01-27T14:59:38.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe39582f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3901efc50 con 0x7fe390153cb0 2024-01-27T14:59:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.245+0000 7fe38effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.246+0000 7fe38e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe39006ed90 0x7fe3901e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.246+0000 7fe38f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe390153cb0 0x7fe390142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.246+0000 7fe38effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37472/0 (socket says 172.21.15.46:37472) 2024-01-27T14:59:38.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.246+0000 7fe38effd640 1 -- 172.21.15.46:0/931242231 learned_addr learned my addr 172.21.15.46:0/931242231 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.250+0000 7fe38effd640 1 -- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe390153cb0 msgr2=0x7fe390142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.250+0000 7fe38effd640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe390153cb0 0x7fe390142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.250+0000 7fe38effd640 1 -- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe39006ed90 msgr2=0x7fe3901e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.250+0000 7fe38effd640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe39006ed90 0x7fe3901e6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.250+0000 7fe38effd640 1 -- 172.21.15.46:0/931242231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009400 con 0x7fe39006b0d0 2024-01-27T14:59:38.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.252+0000 7fe38effd640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098c0 tx=0x7fe3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.255+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388046070 con 0x7fe39006b0d0 2024-01-27T14:59:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.255+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880376d0 con 0x7fe39006b0d0 2024-01-27T14:59:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.255+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38803b040 con 0x7fe39006b0d0 2024-01-27T14:59:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.255+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3901eff30 con 0x7fe39006b0d0 2024-01-27T14:59:38.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.255+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3901f04f0 con 0x7fe39006b0d0 2024-01-27T14:59:38.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.256+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900742e0 con 0x7fe39006b0d0 2024-01-27T14:59:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.525+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe388037a80 con 0x7fe39006b0d0 2024-01-27T14:59:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.525+0000 7fe387fff640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 0x7fe37006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.526+0000 7fe38e7fc640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 0x7fe37006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.526+0000 7fe38e7fc640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 0x7fe37006d3e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3900cb870 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:38.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.539+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fe38807b4b0 con 0x7fe39006b0d0 2024-01-27T14:59:38.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.539+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe3880777f0 con 0x7fe39006b0d0 2024-01-27T14:59:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.732+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe39014dd30 con 0x7fe39006b0d0 2024-01-27T14:59:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.737+0000 7fe387fff640 1 -- 172.21.15.46:0/931242231 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe38807ae10 con 0x7fe39006b0d0 2024-01-27T14:59:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 msgr2=0x7fe37006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 0x7fe37006d3e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3900cb870 tx=0x7fe378009040 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 msgr2=0x7fe3900c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098c0 tx=0x7fe3880046c0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 shutdown_connections 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fe37006af20 0x7fe37006d3e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe39006ed90 0x7fe3901e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe390153cb0 0x7fe390142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 --2- 172.21.15.46:0/931242231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe39006b0d0 0x7fe3900c6670 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 >> 172.21.15.46:0/931242231 conn(0x7fe3900cbf80 msgr2=0x7fe3900c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:38.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 shutdown_connections 2024-01-27T14:59:38.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:38.739+0000 7fe39582f640 1 -- 172.21.15.46:0/931242231 wait complete. 2024-01-27T14:59:38.752 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-27T14:59:38.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:59:38.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-27T14:59:38.780 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:59:38.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[47624]: fuse finished with error 0 and tester_r 0 2024-01-27T14:59:39.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:26:49.159 47624== 2024-01-27T14:59:39.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:26:49.159 47624== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T14:59:39.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T14:59:44.882 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T14:59:44.883 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:59:44.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:59:44.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-27T14:59:44.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:59:44.902 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T14:59:44.960 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-27T14:59:44.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:59:44.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:59:45.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:59:45.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-27T14:59:45.136 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-27T14:59:45.144 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-27T14:59:45.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:59:45.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.248+0000 7f189d56f640 1 Processor -- start 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 -- start start 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f189815d5f0 0x7f18980cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189806c410 con 0x7f1898153b80 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189806bb70 con 0x7f189815d5f0 2024-01-27T14:59:45.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.249+0000 7f189d56f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189806be50 con 0x7f1898159680 2024-01-27T14:59:45.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.250+0000 7f18967fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.250+0000 7f18977fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f189815d5f0 0x7f18980cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.251+0000 7f18967fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:53384/0 (socket says 172.21.15.46:53384) 2024-01-27T14:59:45.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.251+0000 7f18967fc640 1 -- 172.21.15.46:0/2787844579 learned_addr learned my addr 172.21.15.46:0/2787844579 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:45.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.254+0000 7f18967fc640 1 -- 172.21.15.46:0/2787844579 >> v2:172.21.15.73:3300/0 conn(0x7f189815d5f0 msgr2=0x7f18980cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:45.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.254+0000 7f18967fc640 1 --2- 172.21.15.46:0/2787844579 >> v2:172.21.15.73:3300/0 conn(0x7f189815d5f0 0x7f18980cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.254+0000 7f18967fc640 1 -- 172.21.15.46:0/2787844579 >> v1:172.21.15.73:6789/0 conn(0x7f1898153b80 legacy=0x7f18980c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:45.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.254+0000 7f18967fc640 1 -- 172.21.15.46:0/2787844579 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189806c130 con 0x7f1898159680 2024-01-27T14:59:45.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.256+0000 7f18967fc640 1 --2- 172.21.15.46:0/2787844579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f188c009870 tx=0x7f188c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8980f37cbbe1702 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:45.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.260+0000 7f1895ffb640 1 -- 172.21.15.46:0/2787844579 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0317c0 con 0x7f1898159680 2024-01-27T14:59:45.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f1895ffb640 1 -- 172.21.15.46:0/2787844579 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c031920 con 0x7f1898159680 2024-01-27T14:59:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f1895ffb640 1 -- 172.21.15.46:0/2787844579 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c031cb0 con 0x7f1898159680 2024-01-27T14:59:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 -- 172.21.15.46:0/2787844579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 msgr2=0x7f189806b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 --2- 172.21.15.46:0/2787844579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f188c009870 tx=0x7f188c02b860 comp rx=0 tx=0).stop 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 -- 172.21.15.46:0/2787844579 shutdown_connections 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 --2- 172.21.15.46:0/2787844579 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1898159680 0x7f189806b500 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 --2- 172.21.15.46:0/2787844579 >> v2:172.21.15.73:3300/0 conn(0x7f189815d5f0 0x7f18980cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 -- 172.21.15.46:0/2787844579 >> 172.21.15.46:0/2787844579 conn(0x7f189806e110 msgr2=0x7f189806e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 -- 172.21.15.46:0/2787844579 shutdown_connections 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.261+0000 7f189d56f640 1 -- 172.21.15.46:0/2787844579 wait complete. 2024-01-27T14:59:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 Processor -- start 2024-01-27T14:59:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 -- start start 2024-01-27T14:59:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1898153b80 0x7f1898154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18980c3c50 0x7f1898155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898154170 con 0x7f189815d5f0 2024-01-27T14:59:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980b1f20 con 0x7f1898153b80 2024-01-27T14:59:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.263+0000 7f189d56f640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980b21e0 con 0x7f18980c3c50 2024-01-27T14:59:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.264+0000 7f18967fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.264+0000 7f18977fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18980c3c50 0x7f1898155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.264+0000 7f1896ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1898153b80 0x7f1898154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.264+0000 7f18967fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33716/0 (socket says 172.21.15.46:33716) 2024-01-27T14:59:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.264+0000 7f18967fc640 1 -- 172.21.15.46:0/2840155531 learned_addr learned my addr 172.21.15.46:0/2840155531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.268+0000 7f18967fc640 1 -- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18980c3c50 msgr2=0x7f1898155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.268+0000 7f18967fc640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18980c3c50 0x7f1898155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.268+0000 7f18967fc640 1 -- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1898153b80 msgr2=0x7f1898154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.268+0000 7f18967fc640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1898153b80 0x7f1898154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.268+0000 7f18967fc640 1 -- 172.21.15.46:0/2840155531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0094d0 con 0x7f189815d5f0 2024-01-27T14:59:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.270+0000 7f18967fc640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f188c000c00 tx=0x7f188c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.274+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c032860 con 0x7f189815d5f0 2024-01-27T14:59:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.274+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0329e0 con 0x7f189815d5f0 2024-01-27T14:59:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.274+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c032d90 con 0x7f189815d5f0 2024-01-27T14:59:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.274+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18981efa70 con 0x7f189815d5f0 2024-01-27T14:59:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.274+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1898155750 con 0x7f189815d5f0 2024-01-27T14:59:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.275+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18981555b0 con 0x7f189815d5f0 2024-01-27T14:59:45.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.294+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f188c04e450 con 0x7f189815d5f0 2024-01-27T14:59:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.295+0000 7f187f7fe640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 0x7f188406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.295+0000 7f1896ffd640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 0x7f188406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.295+0000 7f1896ffd640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 0x7f188406d3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1888006fd0 tx=0x7f1888009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.298+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f188c07a3e0 con 0x7f189815d5f0 2024-01-27T14:59:45.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.555+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f188c076720 con 0x7f189815d5f0 2024-01-27T14:59:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.746+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18980c7a50 con 0x7f188406af20 2024-01-27T14:59:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.756+0000 7f187f7fe640 1 -- 172.21.15.46:0/2840155531 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370892 (secure 0 0 0) 0x7f1888009550 con 0x7f188406af20 2024-01-27T14:59:45.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:59:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 msgr2=0x7f188406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 0x7f188406d3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1888006fd0 tx=0x7f1888009060 comp rx=0 tx=0).stop 2024-01-27T14:59:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 msgr2=0x7f18980c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f188c000c00 tx=0x7f188c0046c0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 shutdown_connections 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f188406af20 0x7f188406d3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18980c3c50 0x7f1898155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f189815d5f0 0x7f18980c3710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 --2- 172.21.15.46:0/2840155531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1898153b80 0x7f1898154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 >> 172.21.15.46:0/2840155531 conn(0x7f189806e110 msgr2=0x7f1898158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 shutdown_connections 2024-01-27T14:59:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.760+0000 7f189d56f640 1 -- 172.21.15.46:0/2840155531 wait complete. 2024-01-27T14:59:45.773 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":872,"stamp":"2024-01-27T14:59:45.386295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15330,"ondisk_log_size":15330,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472000,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":389491,"kb_avail":754502720,"statfs":{"total":773094113280,"available":772610785280,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":398839345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66345,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":36,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003267"},"pg_stats":[{"pgid":"2.1f","version":"29'615","reported_seq":654,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.880144+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:59:17.880144+0000","last_peered":"2024-01-27T14:59:17.880144+0000","last_clean":"2024-01-27T14:59:17.880144+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:17.880144+0000","last_undegraded":"2024-01-27T14:59:17.880144+0000","last_fullsized":"2024-01-27T14:59:17.880144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050863+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:59:39.050863+0000","last_peered":"2024-01-27T14:59:39.050863+0000","last_clean":"2024-01-27T14:59:39.050863+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:59:39.050863+0000","last_undegraded":"2024-01-27T14:59:39.050863+0000","last_fullsized":"2024-01-27T14:59:39.050863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.823203+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:59:09.823203+0000","last_peered":"2024-01-27T14:59:09.823203+0000","last_clean":"2024-01-27T14:59:09.823203+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:59:09.823203+0000","last_undegraded":"2024-01-27T14:59:09.823203+0000","last_fullsized":"2024-01-27T14:59:09.823203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'728","reported_seq":769,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:54.356055+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:57:54.356055+0000","last_peered":"2024-01-27T14:57:54.356055+0000","last_clean":"2024-01-27T14:57:54.356055+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:57:54.356055+0000","last_undegraded":"2024-01-27T14:57:54.356055+0000","last_fullsized":"2024-01-27T14:57:54.356055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050337+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:59:39.050337+0000","last_peered":"2024-01-27T14:59:39.050337+0000","last_clean":"2024-01-27T14:59:39.050337+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:39.050337+0000","last_undegraded":"2024-01-27T14:59:39.050337+0000","last_fullsized":"2024-01-27T14:59:39.050337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.262122+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:59:08.262122+0000","last_peered":"2024-01-27T14:59:08.262122+0000","last_clean":"2024-01-27T14:59:08.262122+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:59:08.262122+0000","last_undegraded":"2024-01-27T14:59:08.262122+0000","last_fullsized":"2024-01-27T14:59:08.262122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1351","reported_seq":1389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.342958+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:59:28.342958+0000","last_peered":"2024-01-27T14:59:28.342958+0000","last_clean":"2024-01-27T14:59:28.342958+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:28.342958+0000","last_undegraded":"2024-01-27T14:59:28.342958+0000","last_fullsized":"2024-01-27T14:59:28.342958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061074+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:59:39.061074+0000","last_peered":"2024-01-27T14:59:39.061074+0000","last_clean":"2024-01-27T14:59:39.061074+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:39.061074+0000","last_undegraded":"2024-01-27T14:59:39.061074+0000","last_fullsized":"2024-01-27T14:59:39.061074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.920655+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:59:09.920655+0000","last_peered":"2024-01-27T14:59:09.920655+0000","last_clean":"2024-01-27T14:59:09.920655+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:59:09.920655+0000","last_undegraded":"2024-01-27T14:59:09.920655+0000","last_fullsized":"2024-01-27T14:59:09.920655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.282247+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:59:24.282247+0000","last_peered":"2024-01-27T14:59:24.282247+0000","last_clean":"2024-01-27T14:59:24.282247+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:24.282247+0000","last_undegraded":"2024-01-27T14:59:24.282247+0000","last_fullsized":"2024-01-27T14:59:24.282247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036097+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:59:39.036097+0000","last_peered":"2024-01-27T14:59:39.036097+0000","last_clean":"2024-01-27T14:59:39.036097+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:59:39.036097+0000","last_undegraded":"2024-01-27T14:59:39.036097+0000","last_fullsized":"2024-01-27T14:59:39.036097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.199421+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:59:08.199421+0000","last_peered":"2024-01-27T14:59:08.199421+0000","last_clean":"2024-01-27T14:59:08.199421+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:59:08.199421+0000","last_undegraded":"2024-01-27T14:59:08.199421+0000","last_fullsized":"2024-01-27T14:59:08.199421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.041694+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:59:39.041694+0000","last_peered":"2024-01-27T14:59:39.041694+0000","last_clean":"2024-01-27T14:59:39.041694+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:39.041694+0000","last_undegraded":"2024-01-27T14:59:39.041694+0000","last_fullsized":"2024-01-27T14:59:39.041694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'583","reported_seq":623,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.351839+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:59:25.351839+0000","last_peered":"2024-01-27T14:59:25.351839+0000","last_clean":"2024-01-27T14:59:25.351839+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:59:25.351839+0000","last_undegraded":"2024-01-27T14:59:25.351839+0000","last_fullsized":"2024-01-27T14:59:25.351839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.780557+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:59:09.780557+0000","last_peered":"2024-01-27T14:59:09.780557+0000","last_clean":"2024-01-27T14:59:09.780557+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:59:09.780557+0000","last_undegraded":"2024-01-27T14:59:09.780557+0000","last_fullsized":"2024-01-27T14:59:09.780557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046052+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:59:39.046052+0000","last_peered":"2024-01-27T14:59:39.046052+0000","last_clean":"2024-01-27T14:59:39.046052+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:59:39.046052+0000","last_undegraded":"2024-01-27T14:59:39.046052+0000","last_fullsized":"2024-01-27T14:59:39.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:53.272579+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:57:53.272579+0000","last_peered":"2024-01-27T14:57:53.272579+0000","last_clean":"2024-01-27T14:57:53.272579+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:57:53.272579+0000","last_undegraded":"2024-01-27T14:57:53.272579+0000","last_fullsized":"2024-01-27T14:57:53.272579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.960505+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:59:10.960505+0000","last_peered":"2024-01-27T14:59:10.960505+0000","last_clean":"2024-01-27T14:59:10.960505+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:59:10.960505+0000","last_undegraded":"2024-01-27T14:59:10.960505+0000","last_fullsized":"2024-01-27T14:59:10.960505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155851+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:59:39.155851+0000","last_peered":"2024-01-27T14:59:39.155851+0000","last_clean":"2024-01-27T14:59:39.155851+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:39.155851+0000","last_undegraded":"2024-01-27T14:59:39.155851+0000","last_fullsized":"2024-01-27T14:59:39.155851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.347476+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:59:25.347476+0000","last_peered":"2024-01-27T14:59:25.347476+0000","last_clean":"2024-01-27T14:59:25.347476+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:25.347476+0000","last_undegraded":"2024-01-27T14:59:25.347476+0000","last_fullsized":"2024-01-27T14:59:25.347476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.071002+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:59:08.071002+0000","last_peered":"2024-01-27T14:59:08.071002+0000","last_clean":"2024-01-27T14:59:08.071002+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:59:08.071002+0000","last_undegraded":"2024-01-27T14:59:08.071002+0000","last_fullsized":"2024-01-27T14:59:08.071002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.749392+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:59:09.749392+0000","last_peered":"2024-01-27T14:59:09.749392+0000","last_clean":"2024-01-27T14:59:09.749392+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:59:09.749392+0000","last_undegraded":"2024-01-27T14:59:09.749392+0000","last_fullsized":"2024-01-27T14:59:09.749392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:27.420001+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:59:27.420001+0000","last_peered":"2024-01-27T14:59:27.420001+0000","last_clean":"2024-01-27T14:59:27.420001+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:27.420001+0000","last_undegraded":"2024-01-27T14:59:27.420001+0000","last_fullsized":"2024-01-27T14:59:27.420001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.931840+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:59:10.931840+0000","last_peered":"2024-01-27T14:59:10.931840+0000","last_clean":"2024-01-27T14:59:10.931840+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:10.931840+0000","last_undegraded":"2024-01-27T14:59:10.931840+0000","last_fullsized":"2024-01-27T14:59:10.931840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155893+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:59:39.155893+0000","last_peered":"2024-01-27T14:59:39.155893+0000","last_clean":"2024-01-27T14:59:39.155893+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:59:39.155893+0000","last_undegraded":"2024-01-27T14:59:39.155893+0000","last_fullsized":"2024-01-27T14:59:39.155893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'14","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315901+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:59:31.315901+0000","last_peered":"2024-01-27T14:59:31.315901+0000","last_clean":"2024-01-27T14:59:31.315901+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:59:31.315901+0000","last_undegraded":"2024-01-27T14:59:31.315901+0000","last_fullsized":"2024-01-27T14:59:31.315901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.328213+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:59:08.328213+0000","last_peered":"2024-01-27T14:59:08.328213+0000","last_clean":"2024-01-27T14:59:08.328213+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:59:08.328213+0000","last_undegraded":"2024-01-27T14:59:08.328213+0000","last_fullsized":"2024-01-27T14:59:08.328213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157679+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:59:39.157679+0000","last_peered":"2024-01-27T14:59:39.157679+0000","last_clean":"2024-01-27T14:59:39.157679+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:59:39.157679+0000","last_undegraded":"2024-01-27T14:59:39.157679+0000","last_fullsized":"2024-01-27T14:59:39.157679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'316","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:34.094369+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:59:34.094369+0000","last_peered":"2024-01-27T14:59:34.094369+0000","last_clean":"2024-01-27T14:59:34.094369+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:34.094369+0000","last_undegraded":"2024-01-27T14:59:34.094369+0000","last_fullsized":"2024-01-27T14:59:34.094369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826340+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:59:09.826340+0000","last_peered":"2024-01-27T14:59:09.826340+0000","last_clean":"2024-01-27T14:59:09.826340+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:59:09.826340+0000","last_undegraded":"2024-01-27T14:59:09.826340+0000","last_fullsized":"2024-01-27T14:59:09.826340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022193+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:59:39.022193+0000","last_peered":"2024-01-27T14:59:39.022193+0000","last_clean":"2024-01-27T14:59:39.022193+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:59:39.022193+0000","last_undegraded":"2024-01-27T14:59:39.022193+0000","last_fullsized":"2024-01-27T14:59:39.022193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.316294+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:59:24.316294+0000","last_peered":"2024-01-27T14:59:24.316294+0000","last_clean":"2024-01-27T14:59:24.316294+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:59:24.316294+0000","last_undegraded":"2024-01-27T14:59:24.316294+0000","last_fullsized":"2024-01-27T14:59:24.316294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.167503+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:59:08.167503+0000","last_peered":"2024-01-27T14:59:08.167503+0000","last_clean":"2024-01-27T14:59:08.167503+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:59:08.167503+0000","last_undegraded":"2024-01-27T14:59:08.167503+0000","last_fullsized":"2024-01-27T14:59:08.167503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058740+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:59:39.058740+0000","last_peered":"2024-01-27T14:59:39.058740+0000","last_clean":"2024-01-27T14:59:39.058740+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:39.058740+0000","last_undegraded":"2024-01-27T14:59:39.058740+0000","last_fullsized":"2024-01-27T14:59:39.058740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:58:59.361308+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:58:59.361308+0000","last_peered":"2024-01-27T14:58:59.361308+0000","last_clean":"2024-01-27T14:58:59.361308+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:58:59.361308+0000","last_undegraded":"2024-01-27T14:58:59.361308+0000","last_fullsized":"2024-01-27T14:58:59.361308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.911629+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:59:09.911629+0000","last_peered":"2024-01-27T14:59:09.911629+0000","last_clean":"2024-01-27T14:59:09.911629+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:59:09.911629+0000","last_undegraded":"2024-01-27T14:59:09.911629+0000","last_fullsized":"2024-01-27T14:59:09.911629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.067394+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:59:39.067394+0000","last_peered":"2024-01-27T14:59:39.067394+0000","last_clean":"2024-01-27T14:59:39.067394+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:59:39.067394+0000","last_undegraded":"2024-01-27T14:59:39.067394+0000","last_fullsized":"2024-01-27T14:59:39.067394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'10","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.340212+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:59:25.340212+0000","last_peered":"2024-01-27T14:59:25.340212+0000","last_clean":"2024-01-27T14:59:25.340212+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:59:25.340212+0000","last_undegraded":"2024-01-27T14:59:25.340212+0000","last_fullsized":"2024-01-27T14:59:25.340212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.875622+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:59:10.875622+0000","last_peered":"2024-01-27T14:59:10.875622+0000","last_clean":"2024-01-27T14:59:10.875622+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:59:10.875622+0000","last_undegraded":"2024-01-27T14:59:10.875622+0000","last_fullsized":"2024-01-27T14:59:10.875622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049959+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:59:39.049959+0000","last_peered":"2024-01-27T14:59:39.049959+0000","last_clean":"2024-01-27T14:59:39.049959+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:59:39.049959+0000","last_undegraded":"2024-01-27T14:59:39.049959+0000","last_fullsized":"2024-01-27T14:59:39.049959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'934","reported_seq":1898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:36.353045+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:59:36.353045+0000","last_peered":"2024-01-27T14:59:36.353045+0000","last_clean":"2024-01-27T14:59:36.353045+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:36.353045+0000","last_undegraded":"2024-01-27T14:59:36.353045+0000","last_fullsized":"2024-01-27T14:59:36.353045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.790336+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:59:09.790336+0000","last_peered":"2024-01-27T14:59:09.790336+0000","last_clean":"2024-01-27T14:59:09.790336+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:59:09.790336+0000","last_undegraded":"2024-01-27T14:59:09.790336+0000","last_fullsized":"2024-01-27T14:59:09.790336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021770+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:59:39.021770+0000","last_peered":"2024-01-27T14:59:39.021770+0000","last_clean":"2024-01-27T14:59:39.021770+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:39.021770+0000","last_undegraded":"2024-01-27T14:59:39.021770+0000","last_fullsized":"2024-01-27T14:59:39.021770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'478","reported_seq":519,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.853827+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:59:15.853827+0000","last_peered":"2024-01-27T14:59:15.853827+0000","last_clean":"2024-01-27T14:59:15.853827+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:59:15.853827+0000","last_undegraded":"2024-01-27T14:59:15.853827+0000","last_fullsized":"2024-01-27T14:59:15.853827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":166,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.940972+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:59:10.940972+0000","last_peered":"2024-01-27T14:59:10.940972+0000","last_clean":"2024-01-27T14:59:10.940972+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:59:10.940972+0000","last_undegraded":"2024-01-27T14:59:10.940972+0000","last_fullsized":"2024-01-27T14:59:10.940972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.154667+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:59:39.154667+0000","last_peered":"2024-01-27T14:59:39.154667+0000","last_clean":"2024-01-27T14:59:39.154667+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:59:39.154667+0000","last_undegraded":"2024-01-27T14:59:39.154667+0000","last_fullsized":"2024-01-27T14:59:39.154667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'12","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315933+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:59:31.315933+0000","last_peered":"2024-01-27T14:59:31.315933+0000","last_clean":"2024-01-27T14:59:31.315933+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:59:31.315933+0000","last_undegraded":"2024-01-27T14:59:31.315933+0000","last_fullsized":"2024-01-27T14:59:31.315933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:39.292535+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:57:39.292535+0000","last_peered":"2024-01-27T14:57:39.292535+0000","last_clean":"2024-01-27T14:57:39.292535+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:57:39.292535+0000","last_undegraded":"2024-01-27T14:57:39.292535+0000","last_fullsized":"2024-01-27T14:57:39.292535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.317475+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:59:09.317475+0000","last_peered":"2024-01-27T14:59:09.317475+0000","last_clean":"2024-01-27T14:59:09.317475+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:59:09.317475+0000","last_undegraded":"2024-01-27T14:59:09.317475+0000","last_fullsized":"2024-01-27T14:59:09.317475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036199+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:59:39.036199+0000","last_peered":"2024-01-27T14:59:39.036199+0000","last_clean":"2024-01-27T14:59:39.036199+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:39.036199+0000","last_undegraded":"2024-01-27T14:59:39.036199+0000","last_fullsized":"2024-01-27T14:59:39.036199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.360055+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:59:32.360055+0000","last_peered":"2024-01-27T14:59:32.360055+0000","last_clean":"2024-01-27T14:59:32.360055+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:32.360055+0000","last_undegraded":"2024-01-27T14:59:32.360055+0000","last_fullsized":"2024-01-27T14:59:32.360055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.786852+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:59:10.786852+0000","last_peered":"2024-01-27T14:59:10.786852+0000","last_clean":"2024-01-27T14:59:10.786852+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:59:10.786852+0000","last_undegraded":"2024-01-27T14:59:10.786852+0000","last_fullsized":"2024-01-27T14:59:10.786852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124898+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:59:39.124898+0000","last_peered":"2024-01-27T14:59:39.124898+0000","last_clean":"2024-01-27T14:59:39.124898+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:59:39.124898+0000","last_undegraded":"2024-01-27T14:59:39.124898+0000","last_fullsized":"2024-01-27T14:59:39.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.320392+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:59:24.320392+0000","last_peered":"2024-01-27T14:59:24.320392+0000","last_clean":"2024-01-27T14:59:24.320392+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:24.320392+0000","last_undegraded":"2024-01-27T14:59:24.320392+0000","last_fullsized":"2024-01-27T14:59:24.320392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":213,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.599426+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:59:08.599426+0000","last_peered":"2024-01-27T14:59:08.599426+0000","last_clean":"2024-01-27T14:59:08.599426+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:59:08.599426+0000","last_undegraded":"2024-01-27T14:59:08.599426+0000","last_fullsized":"2024-01-27T14:59:08.599426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145584+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:59:39.145584+0000","last_peered":"2024-01-27T14:59:39.145584+0000","last_clean":"2024-01-27T14:59:39.145584+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:59:39.145584+0000","last_undegraded":"2024-01-27T14:59:39.145584+0000","last_fullsized":"2024-01-27T14:59:39.145584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:22.083460+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:59:22.083460+0000","last_peered":"2024-01-27T14:59:22.083460+0000","last_clean":"2024-01-27T14:59:22.083460+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:22.083460+0000","last_undegraded":"2024-01-27T14:59:22.083460+0000","last_fullsized":"2024-01-27T14:59:22.083460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.647605+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:59:08.647605+0000","last_peered":"2024-01-27T14:59:08.647605+0000","last_clean":"2024-01-27T14:59:08.647605+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:59:08.647605+0000","last_undegraded":"2024-01-27T14:59:08.647605+0000","last_fullsized":"2024-01-27T14:59:08.647605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051278+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:59:39.051278+0000","last_peered":"2024-01-27T14:59:39.051278+0000","last_clean":"2024-01-27T14:59:39.051278+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:39.051278+0000","last_undegraded":"2024-01-27T14:59:39.051278+0000","last_fullsized":"2024-01-27T14:59:39.051278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.843679+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:59:15.843679+0000","last_peered":"2024-01-27T14:59:15.843679+0000","last_clean":"2024-01-27T14:59:15.843679+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:15.843679+0000","last_undegraded":"2024-01-27T14:59:15.843679+0000","last_fullsized":"2024-01-27T14:59:15.843679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.364571+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:59:08.364571+0000","last_peered":"2024-01-27T14:59:08.364571+0000","last_clean":"2024-01-27T14:59:08.364571+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:08.364571+0000","last_undegraded":"2024-01-27T14:59:08.364571+0000","last_fullsized":"2024-01-27T14:59:08.364571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027341+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:59:39.027341+0000","last_peered":"2024-01-27T14:59:39.027341+0000","last_clean":"2024-01-27T14:59:39.027341+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:39.027341+0000","last_undegraded":"2024-01-27T14:59:39.027341+0000","last_fullsized":"2024-01-27T14:59:39.027341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.047429+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:59:20.047429+0000","last_peered":"2024-01-27T14:59:20.047429+0000","last_clean":"2024-01-27T14:59:20.047429+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:20.047429+0000","last_undegraded":"2024-01-27T14:59:20.047429+0000","last_fullsized":"2024-01-27T14:59:20.047429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826757+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:59:10.826757+0000","last_peered":"2024-01-27T14:59:10.826757+0000","last_clean":"2024-01-27T14:59:10.826757+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:59:10.826757+0000","last_undegraded":"2024-01-27T14:59:10.826757+0000","last_fullsized":"2024-01-27T14:59:10.826757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049463+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:59:39.049463+0000","last_peered":"2024-01-27T14:59:39.049463+0000","last_clean":"2024-01-27T14:59:39.049463+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:39.049463+0000","last_undegraded":"2024-01-27T14:59:39.049463+0000","last_fullsized":"2024-01-27T14:59:39.049463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:21.028639+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:59:21.028639+0000","last_peered":"2024-01-27T14:59:21.028639+0000","last_clean":"2024-01-27T14:59:21.028639+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:21.028639+0000","last_undegraded":"2024-01-27T14:59:21.028639+0000","last_fullsized":"2024-01-27T14:59:21.028639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":148,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.801323+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:59:10.801323+0000","last_peered":"2024-01-27T14:59:10.801323+0000","last_clean":"2024-01-27T14:59:10.801323+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:59:10.801323+0000","last_undegraded":"2024-01-27T14:59:10.801323+0000","last_fullsized":"2024-01-27T14:59:10.801323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.038975+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:59:39.038975+0000","last_peered":"2024-01-27T14:59:39.038975+0000","last_clean":"2024-01-27T14:59:39.038975+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:59:39.038975+0000","last_undegraded":"2024-01-27T14:59:39.038975+0000","last_fullsized":"2024-01-27T14:59:39.038975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'13","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315964+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:59:31.315964+0000","last_peered":"2024-01-27T14:59:31.315964+0000","last_clean":"2024-01-27T14:59:31.315964+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:59:31.315964+0000","last_undegraded":"2024-01-27T14:59:31.315964+0000","last_fullsized":"2024-01-27T14:59:31.315964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.246924+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:59:08.246924+0000","last_peered":"2024-01-27T14:59:08.246924+0000","last_clean":"2024-01-27T14:59:08.246924+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:59:08.246924+0000","last_undegraded":"2024-01-27T14:59:08.246924+0000","last_fullsized":"2024-01-27T14:59:08.246924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020881+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:59:39.020881+0000","last_peered":"2024-01-27T14:59:39.020881+0000","last_clean":"2024-01-27T14:59:39.020881+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.020881+0000","last_undegraded":"2024-01-27T14:59:39.020881+0000","last_fullsized":"2024-01-27T14:59:39.020881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'260","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.313960+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:59:39.313960+0000","last_peered":"2024-01-27T14:59:39.313960+0000","last_clean":"2024-01-27T14:59:39.313960+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:39.313960+0000","last_undegraded":"2024-01-27T14:59:39.313960+0000","last_fullsized":"2024-01-27T14:59:39.313960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:07.923827+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:59:07.923827+0000","last_peered":"2024-01-27T14:59:07.923827+0000","last_clean":"2024-01-27T14:59:07.923827+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:59:07.923827+0000","last_undegraded":"2024-01-27T14:59:07.923827+0000","last_fullsized":"2024-01-27T14:59:07.923827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124883+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:59:39.124883+0000","last_peered":"2024-01-27T14:59:39.124883+0000","last_clean":"2024-01-27T14:59:39.124883+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:59:39.124883+0000","last_undegraded":"2024-01-27T14:59:39.124883+0000","last_fullsized":"2024-01-27T14:59:39.124883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'829","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.293124+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:59:24.293124+0000","last_peered":"2024-01-27T14:59:24.293124+0000","last_clean":"2024-01-27T14:59:24.293124+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:24.293124+0000","last_undegraded":"2024-01-27T14:59:24.293124+0000","last_fullsized":"2024-01-27T14:59:24.293124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826629+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:59:09.826629+0000","last_peered":"2024-01-27T14:59:09.826629+0000","last_clean":"2024-01-27T14:59:09.826629+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:59:09.826629+0000","last_undegraded":"2024-01-27T14:59:09.826629+0000","last_fullsized":"2024-01-27T14:59:09.826629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.040394+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:59:39.040394+0000","last_peered":"2024-01-27T14:59:39.040394+0000","last_clean":"2024-01-27T14:59:39.040394+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:39.040394+0000","last_undegraded":"2024-01-27T14:59:39.040394+0000","last_fullsized":"2024-01-27T14:59:39.040394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'629","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.377338+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:59:32.377338+0000","last_peered":"2024-01-27T14:59:32.377338+0000","last_clean":"2024-01-27T14:59:32.377338+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:32.377338+0000","last_undegraded":"2024-01-27T14:59:32.377338+0000","last_fullsized":"2024-01-27T14:59:32.377338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.914090+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:59:09.914090+0000","last_peered":"2024-01-27T14:59:09.914090+0000","last_clean":"2024-01-27T14:59:09.914090+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:59:09.914090+0000","last_undegraded":"2024-01-27T14:59:09.914090+0000","last_fullsized":"2024-01-27T14:59:09.914090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.052297+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:59:39.052297+0000","last_peered":"2024-01-27T14:59:39.052297+0000","last_clean":"2024-01-27T14:59:39.052297+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:59:39.052297+0000","last_undegraded":"2024-01-27T14:59:39.052297+0000","last_fullsized":"2024-01-27T14:59:39.052297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.311314+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:59:31.311314+0000","last_peered":"2024-01-27T14:59:31.311314+0000","last_clean":"2024-01-27T14:59:31.311314+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:31.311314+0000","last_undegraded":"2024-01-27T14:59:31.311314+0000","last_fullsized":"2024-01-27T14:59:31.311314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.360645+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:59:08.360645+0000","last_peered":"2024-01-27T14:59:08.360645+0000","last_clean":"2024-01-27T14:59:08.360645+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:59:08.360645+0000","last_undegraded":"2024-01-27T14:59:08.360645+0000","last_fullsized":"2024-01-27T14:59:08.360645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065121+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:59:39.065121+0000","last_peered":"2024-01-27T14:59:39.065121+0000","last_clean":"2024-01-27T14:59:39.065121+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:39.065121+0000","last_undegraded":"2024-01-27T14:59:39.065121+0000","last_fullsized":"2024-01-27T14:59:39.065121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'17","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:38.839260+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:59:38.839260+0000","last_peered":"2024-01-27T14:59:38.839260+0000","last_clean":"2024-01-27T14:59:38.839260+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:38.839260+0000","last_undegraded":"2024-01-27T14:59:38.839260+0000","last_fullsized":"2024-01-27T14:59:38.839260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.861248+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:59:10.861248+0000","last_peered":"2024-01-27T14:59:10.861248+0000","last_clean":"2024-01-27T14:59:10.861248+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:59:10.861248+0000","last_undegraded":"2024-01-27T14:59:10.861248+0000","last_fullsized":"2024-01-27T14:59:10.861248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989182+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:59:10.989182+0000","last_peered":"2024-01-27T14:59:10.989182+0000","last_clean":"2024-01-27T14:59:10.989182+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:59:10.989182+0000","last_undegraded":"2024-01-27T14:59:10.989182+0000","last_fullsized":"2024-01-27T14:59:10.989182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.159992+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:59:39.159992+0000","last_peered":"2024-01-27T14:59:39.159992+0000","last_clean":"2024-01-27T14:59:39.159992+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:39.159992+0000","last_undegraded":"2024-01-27T14:59:39.159992+0000","last_fullsized":"2024-01-27T14:59:39.159992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.861159+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:59:17.861159+0000","last_peered":"2024-01-27T14:59:17.861159+0000","last_clean":"2024-01-27T14:59:17.861159+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:59:17.861159+0000","last_undegraded":"2024-01-27T14:59:17.861159+0000","last_fullsized":"2024-01-27T14:59:17.861159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.930556+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:59:09.930556+0000","last_peered":"2024-01-27T14:59:09.930556+0000","last_clean":"2024-01-27T14:59:09.930556+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:59:09.930556+0000","last_undegraded":"2024-01-27T14:59:09.930556+0000","last_fullsized":"2024-01-27T14:59:09.930556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048755+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:59:39.048755+0000","last_peered":"2024-01-27T14:59:39.048755+0000","last_clean":"2024-01-27T14:59:39.048755+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:59:39.048755+0000","last_undegraded":"2024-01-27T14:59:39.048755+0000","last_fullsized":"2024-01-27T14:59:39.048755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.046360+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:59:20.046360+0000","last_peered":"2024-01-27T14:59:20.046360+0000","last_clean":"2024-01-27T14:59:20.046360+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:20.046360+0000","last_undegraded":"2024-01-27T14:59:20.046360+0000","last_fullsized":"2024-01-27T14:59:20.046360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'660","reported_seq":699,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:30.373035+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:59:30.373035+0000","last_peered":"2024-01-27T14:59:30.373035+0000","last_clean":"2024-01-27T14:59:30.373035+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:59:30.373035+0000","last_undegraded":"2024-01-27T14:59:30.373035+0000","last_fullsized":"2024-01-27T14:59:30.373035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157899+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:59:39.157899+0000","last_peered":"2024-01-27T14:59:39.157899+0000","last_clean":"2024-01-27T14:59:39.157899+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:59:39.157899+0000","last_undegraded":"2024-01-27T14:59:39.157899+0000","last_fullsized":"2024-01-27T14:59:39.157899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989218+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:59:10.989218+0000","last_peered":"2024-01-27T14:59:10.989218+0000","last_clean":"2024-01-27T14:59:10.989218+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:59:10.989218+0000","last_undegraded":"2024-01-27T14:59:10.989218+0000","last_fullsized":"2024-01-27T14:59:10.989218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.362004+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:59:29.362004+0000","last_peered":"2024-01-27T14:59:29.362004+0000","last_clean":"2024-01-27T14:59:29.362004+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:29.362004+0000","last_undegraded":"2024-01-27T14:59:29.362004+0000","last_fullsized":"2024-01-27T14:59:29.362004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.057195+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:59:39.057195+0000","last_peered":"2024-01-27T14:59:39.057195+0000","last_clean":"2024-01-27T14:59:39.057195+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:39.057195+0000","last_undegraded":"2024-01-27T14:59:39.057195+0000","last_fullsized":"2024-01-27T14:59:39.057195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.799454+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:59:10.799454+0000","last_peered":"2024-01-27T14:59:10.799454+0000","last_clean":"2024-01-27T14:59:10.799454+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:59:10.799454+0000","last_undegraded":"2024-01-27T14:59:10.799454+0000","last_fullsized":"2024-01-27T14:59:10.799454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.062850+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:59:39.062850+0000","last_peered":"2024-01-27T14:59:39.062850+0000","last_clean":"2024-01-27T14:59:39.062850+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:39.062850+0000","last_undegraded":"2024-01-27T14:59:39.062850+0000","last_fullsized":"2024-01-27T14:59:39.062850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.045705+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:59:39.045705+0000","last_peered":"2024-01-27T14:59:39.045705+0000","last_clean":"2024-01-27T14:59:39.045705+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:39.045705+0000","last_undegraded":"2024-01-27T14:59:39.045705+0000","last_fullsized":"2024-01-27T14:59:39.045705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022545+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:59:39.022545+0000","last_peered":"2024-01-27T14:59:39.022545+0000","last_clean":"2024-01-27T14:59:39.022545+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:39.022545+0000","last_undegraded":"2024-01-27T14:59:39.022545+0000","last_fullsized":"2024-01-27T14:59:39.022545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051601+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:59:39.051601+0000","last_peered":"2024-01-27T14:59:39.051601+0000","last_clean":"2024-01-27T14:59:39.051601+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:39.051601+0000","last_undegraded":"2024-01-27T14:59:39.051601+0000","last_fullsized":"2024-01-27T14:59:39.051601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021084+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:59:39.021084+0000","last_peered":"2024-01-27T14:59:39.021084+0000","last_clean":"2024-01-27T14:59:39.021084+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:59:39.021084+0000","last_undegraded":"2024-01-27T14:59:39.021084+0000","last_fullsized":"2024-01-27T14:59:39.021084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.019956+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:59:39.019956+0000","last_peered":"2024-01-27T14:59:39.019956+0000","last_clean":"2024-01-27T14:59:39.019956+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:59:39.019956+0000","last_undegraded":"2024-01-27T14:59:39.019956+0000","last_fullsized":"2024-01-27T14:59:39.019956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061185+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:59:39.061185+0000","last_peered":"2024-01-27T14:59:39.061185+0000","last_clean":"2024-01-27T14:59:39.061185+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:39.061185+0000","last_undegraded":"2024-01-27T14:59:39.061185+0000","last_fullsized":"2024-01-27T14:59:39.061185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.047267+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:59:39.047267+0000","last_peered":"2024-01-27T14:59:39.047267+0000","last_clean":"2024-01-27T14:59:39.047267+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:59:39.047267+0000","last_undegraded":"2024-01-27T14:59:39.047267+0000","last_fullsized":"2024-01-27T14:59:39.047267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.030949+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:59:39.030949+0000","last_peered":"2024-01-27T14:59:39.030949+0000","last_clean":"2024-01-27T14:59:39.030949+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:39.030949+0000","last_undegraded":"2024-01-27T14:59:39.030949+0000","last_fullsized":"2024-01-27T14:59:39.030949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050100+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:59:39.050100+0000","last_peered":"2024-01-27T14:59:39.050100+0000","last_clean":"2024-01-27T14:59:39.050100+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:59:39.050100+0000","last_undegraded":"2024-01-27T14:59:39.050100+0000","last_fullsized":"2024-01-27T14:59:39.050100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058983+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:59:39.058983+0000","last_peered":"2024-01-27T14:59:39.058983+0000","last_clean":"2024-01-27T14:59:39.058983+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.058983+0000","last_undegraded":"2024-01-27T14:59:39.058983+0000","last_fullsized":"2024-01-27T14:59:39.058983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157835+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:59:39.157835+0000","last_peered":"2024-01-27T14:59:39.157835+0000","last_clean":"2024-01-27T14:59:39.157835+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:39.157835+0000","last_undegraded":"2024-01-27T14:59:39.157835+0000","last_fullsized":"2024-01-27T14:59:39.157835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145636+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:59:39.145636+0000","last_peered":"2024-01-27T14:59:39.145636+0000","last_clean":"2024-01-27T14:59:39.145636+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:59:39.145636+0000","last_undegraded":"2024-01-27T14:59:39.145636+0000","last_fullsized":"2024-01-27T14:59:39.145636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.023696+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:59:39.023696+0000","last_peered":"2024-01-27T14:59:39.023696+0000","last_clean":"2024-01-27T14:59:39.023696+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:59:39.023696+0000","last_undegraded":"2024-01-27T14:59:39.023696+0000","last_fullsized":"2024-01-27T14:59:39.023696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048100+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:59:39.048100+0000","last_peered":"2024-01-27T14:59:39.048100+0000","last_clean":"2024-01-27T14:59:39.048100+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:59:39.048100+0000","last_undegraded":"2024-01-27T14:59:39.048100+0000","last_fullsized":"2024-01-27T14:59:39.048100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027716+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:59:39.027716+0000","last_peered":"2024-01-27T14:59:39.027716+0000","last_clean":"2024-01-27T14:59:39.027716+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:59:39.027716+0000","last_undegraded":"2024-01-27T14:59:39.027716+0000","last_fullsized":"2024-01-27T14:59:39.027716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.028460+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:59:39.028460+0000","last_peered":"2024-01-27T14:59:39.028460+0000","last_clean":"2024-01-27T14:59:39.028460+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:39.028460+0000","last_undegraded":"2024-01-27T14:59:39.028460+0000","last_fullsized":"2024-01-27T14:59:39.028460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046375+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:59:39.046375+0000","last_peered":"2024-01-27T14:59:39.046375+0000","last_clean":"2024-01-27T14:59:39.046375+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:39.046375+0000","last_undegraded":"2024-01-27T14:59:39.046375+0000","last_fullsized":"2024-01-27T14:59:39.046375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020810+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:59:39.020810+0000","last_peered":"2024-01-27T14:59:39.020810+0000","last_clean":"2024-01-27T14:59:39.020810+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:59:39.020810+0000","last_undegraded":"2024-01-27T14:59:39.020810+0000","last_fullsized":"2024-01-27T14:59:39.020810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020831+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:59:39.020831+0000","last_peered":"2024-01-27T14:59:39.020831+0000","last_clean":"2024-01-27T14:59:39.020831+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:39.020831+0000","last_undegraded":"2024-01-27T14:59:39.020831+0000","last_fullsized":"2024-01-27T14:59:39.020831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.146288+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:59:39.146288+0000","last_peered":"2024-01-27T14:59:39.146288+0000","last_clean":"2024-01-27T14:59:39.146288+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:39.146288+0000","last_undegraded":"2024-01-27T14:59:39.146288+0000","last_fullsized":"2024-01-27T14:59:39.146288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129537+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:59:39.129537+0000","last_peered":"2024-01-27T14:59:39.129537+0000","last_clean":"2024-01-27T14:59:39.129537+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:39.129537+0000","last_undegraded":"2024-01-27T14:59:39.129537+0000","last_fullsized":"2024-01-27T14:59:39.129537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148552+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:59:39.148552+0000","last_peered":"2024-01-27T14:59:39.148552+0000","last_clean":"2024-01-27T14:59:39.148552+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:39.148552+0000","last_undegraded":"2024-01-27T14:59:39.148552+0000","last_fullsized":"2024-01-27T14:59:39.148552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058014+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:59:39.058014+0000","last_peered":"2024-01-27T14:59:39.058014+0000","last_clean":"2024-01-27T14:59:39.058014+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:39.058014+0000","last_undegraded":"2024-01-27T14:59:39.058014+0000","last_fullsized":"2024-01-27T14:59:39.058014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050038+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:59:39.050038+0000","last_peered":"2024-01-27T14:59:39.050038+0000","last_clean":"2024-01-27T14:59:39.050038+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:59:39.050038+0000","last_undegraded":"2024-01-27T14:59:39.050038+0000","last_fullsized":"2024-01-27T14:59:39.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065671+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:59:39.065671+0000","last_peered":"2024-01-27T14:59:39.065671+0000","last_clean":"2024-01-27T14:59:39.065671+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:59:39.065671+0000","last_undegraded":"2024-01-27T14:59:39.065671+0000","last_fullsized":"2024-01-27T14:59:39.065671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.055089+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:59:39.055089+0000","last_peered":"2024-01-27T14:59:39.055089+0000","last_clean":"2024-01-27T14:59:39.055089+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:39.055089+0000","last_undegraded":"2024-01-27T14:59:39.055089+0000","last_fullsized":"2024-01-27T14:59:39.055089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050346+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:59:39.050346+0000","last_peered":"2024-01-27T14:59:39.050346+0000","last_clean":"2024-01-27T14:59:39.050346+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:59:39.050346+0000","last_undegraded":"2024-01-27T14:59:39.050346+0000","last_fullsized":"2024-01-27T14:59:39.050346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065975+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:59:39.065975+0000","last_peered":"2024-01-27T14:59:39.065975+0000","last_clean":"2024-01-27T14:59:39.065975+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:39.065975+0000","last_undegraded":"2024-01-27T14:59:39.065975+0000","last_fullsized":"2024-01-27T14:59:39.065975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048739+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:59:39.048739+0000","last_peered":"2024-01-27T14:59:39.048739+0000","last_clean":"2024-01-27T14:59:39.048739+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:39.048739+0000","last_undegraded":"2024-01-27T14:59:39.048739+0000","last_fullsized":"2024-01-27T14:59:39.048739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.037581+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:59:39.037581+0000","last_peered":"2024-01-27T14:59:39.037581+0000","last_clean":"2024-01-27T14:59:39.037581+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:59:39.037581+0000","last_undegraded":"2024-01-27T14:59:39.037581+0000","last_fullsized":"2024-01-27T14:59:39.037581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.111454+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:59:39.111454+0000","last_peered":"2024-01-27T14:59:39.111454+0000","last_clean":"2024-01-27T14:59:39.111454+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:39.111454+0000","last_undegraded":"2024-01-27T14:59:39.111454+0000","last_fullsized":"2024-01-27T14:59:39.111454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509783,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.58399999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.41699999999999998},"min":{"1min":0.32100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65200000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.434},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.80100000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60799999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.442,"15min":0.441},"min":{"1min":0.33000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.54000000000000004,"5min":0.64200000000000002,"15min":0.66100000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.44600000000000001,"5min":0.60499999999999998,"15min":0.76900000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.55800000000000005,"15min":0.621},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.46600000000000003,"5min":0.54000000000000004,"15min":0.59899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509783,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.58199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.67100000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.64000000000000001},"last":0.62},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66500000000000004},"last":0.63}]},{"osd":3,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.65500000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61899999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.44},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.71999999999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.58599999999999997},"last":0.38800000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.441,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46899999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.19,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.495,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.312},"min":{"1min":0.20899999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.437,"5min":0.47099999999999997,"15min":0.57499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.373,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52500000000000002,"15min":0.68200000000000005},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.53700000000000003,"15min":0.64800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.378},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.72499999999999998},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.432,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.71599999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.71899999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.66200000000000003,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.753},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.41599999999999998,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.78000000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.39100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66400000000000003,"5min":0.67600000000000005,"15min":0.79500000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.75600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.502,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.59399999999999997,"5min":0.73199999999999998,"15min":0.76000000000000001},"last":0.65200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.28599999999999998,"15min":0.28999999999999998},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.375,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":0.58499999999999996,"15min":0.59699999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27300000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.42699999999999999,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.313},"max":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.442,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.65700000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54800000000000004,"5min":0.752,"15min":0.752},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.51800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.191},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.502}]},{"osd":3,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.62},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.248},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.747},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.28999999999999998},"max":{"1min":0.628,"5min":0.872,"15min":0.872},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509782,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":0.45700000000000002,"5min":0.47699999999999998,"15min":0.53700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.315},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.55000000000000004,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.61399999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.192,"15min":0.192},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.224},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.80700000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.63800000000000001,"15min":0.79500000000000004},"last":0.499}]},{"osd":5,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.68600000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.497,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.70599999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.61599999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.23699999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.313,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.68700000000000006},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.51800000000000002,"5min":0.64800000000000002,"15min":0.66100000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59899999999999998,"5min":0.63800000000000001,"15min":0.68899999999999995},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.63300000000000001,"15min":0.63800000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.67400000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Jan 27 14:59:10 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.621},"last":0.501},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51700000000000002,"5min":0.59799999999999998,"15min":0.625},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.65600000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.628}]}]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.501}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:59:45.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:59:45.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.915+0000 7f2d08943640 1 Processor -- start 2024-01-27T14:59:45.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.915+0000 7f2d08943640 1 -- start start 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d04153a30 0x7f2d040cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d040cd360 0x7f2d0406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d0406c460 0x7f2d04159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d04153e10 con 0x7f2d04153a30 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406ba90 con 0x7f2d0406c460 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d08943640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0415cce0 con 0x7f2d040cd360 2024-01-27T14:59:45.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.916+0000 7f2d0259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d04153a30 0x7f2d040cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.917+0000 7f2d0259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d04153a30 0x7f2d040cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33720/0 (socket says 172.21.15.46:33720) 2024-01-27T14:59:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.917+0000 7f2d0259c640 1 -- 172.21.15.46:0/1058497785 learned_addr learned my addr 172.21.15.46:0/1058497785 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:45.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.919+0000 7f2d0259c640 1 -- 172.21.15.46:0/1058497785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d040cd360 msgr2=0x7f2d0406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:45.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.919+0000 7f2d0259c640 1 --2- 172.21.15.46:0/1058497785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d040cd360 0x7f2d0406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.919+0000 7f2d0259c640 1 -- 172.21.15.46:0/1058497785 >> v2:172.21.15.73:3300/0 conn(0x7f2d0406c460 msgr2=0x7f2d04159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:45.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.919+0000 7f2d0259c640 1 --2- 172.21.15.46:0/1058497785 >> v2:172.21.15.73:3300/0 conn(0x7f2d0406c460 0x7f2d04159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.919+0000 7f2d0259c640 1 -- 172.21.15.46:0/1058497785 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0406c8c0 con 0x7f2d04153a30 2024-01-27T14:59:45.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.921+0000 7f2d0259c640 1 --2- 172.21.15.46:0/1058497785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d040cce20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d040c87a0 tx=0x7f2cec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67329930b93fc03 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:45.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.925+0000 7f2d0159a640 1 -- 172.21.15.46:0/1058497785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec030860 con 0x7f2d04153a30 2024-01-27T14:59:45.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.925+0000 7f2d0159a640 1 -- 172.21.15.46:0/1058497785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0309c0 con 0x7f2d04153a30 2024-01-27T14:59:45.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.925+0000 7f2d0159a640 1 -- 172.21.15.46:0/1058497785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec030d50 con 0x7f2d04153a30 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 -- 172.21.15.46:0/1058497785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 msgr2=0x7f2d040cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 --2- 172.21.15.46:0/1058497785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d040cce20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d040c87a0 tx=0x7f2cec02b9a0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 -- 172.21.15.46:0/1058497785 shutdown_connections 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 --2- 172.21.15.46:0/1058497785 >> v2:172.21.15.73:3300/0 conn(0x7f2d0406c460 0x7f2d04159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 --2- 172.21.15.46:0/1058497785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d040cd360 0x7f2d0406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 --2- 172.21.15.46:0/1058497785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d040cce20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 -- 172.21.15.46:0/1058497785 >> 172.21.15.46:0/1058497785 conn(0x7f2d0406a6c0 msgr2=0x7f2d0406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:45.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 -- 172.21.15.46:0/1058497785 shutdown_connections 2024-01-27T14:59:45.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.926+0000 7f2d08943640 1 -- 172.21.15.46:0/1058497785 wait complete. 2024-01-27T14:59:45.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.927+0000 7f2d08943640 1 Processor -- start 2024-01-27T14:59:45.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.927+0000 7f2d08943640 1 -- start start 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d0406c460 0x7f2d04150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d040cd360 0x7f2d04158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04158190 con 0x7f2d04153a30 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041ef960 con 0x7f2d040cd360 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d08943640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041efc40 con 0x7f2d0406c460 2024-01-27T14:59:45.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.928+0000 7f2d02d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:45.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.929+0000 7f2d02d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33724/0 (socket says 172.21.15.46:33724) 2024-01-27T14:59:45.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.929+0000 7f2d02d9d640 1 -- 172.21.15.46:0/3314800307 learned_addr learned my addr 172.21.15.46:0/3314800307 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.932+0000 7f2d02d9d640 1 -- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d0406c460 msgr2=0x7f2d04150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.932+0000 7f2d02d9d640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d0406c460 0x7f2d04150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.932+0000 7f2d02d9d640 1 -- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d040cd360 msgr2=0x7f2d04158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.932+0000 7f2d02d9d640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d040cd360 0x7f2d04158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.932+0000 7f2d02d9d640 1 -- 172.21.15.46:0/3314800307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0094d0 con 0x7f2d04153a30 2024-01-27T14:59:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.934+0000 7f2d02d9d640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b970 tx=0x7f2cfc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:45.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.938+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00cb40 con 0x7f2d04153a30 2024-01-27T14:59:45.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.938+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc00ccc0 con 0x7f2d04153a30 2024-01-27T14:59:45.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.938+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc014680 con 0x7f2d04153a30 2024-01-27T14:59:45.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.938+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d041eff20 con 0x7f2d04153a30 2024-01-27T14:59:45.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.938+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d041583e0 con 0x7f2d04153a30 2024-01-27T14:59:45.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:45.939+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d04158600 con 0x7f2d04153a30 2024-01-27T14:59:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.205+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2cfc007370 con 0x7f2d04153a30 2024-01-27T14:59:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.205+0000 7f2cfaffd640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 0x7f2ce406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.205+0000 7f2d0259c640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 0x7f2ce406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.206+0000 7f2d0259c640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 0x7f2ce406d3e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cec036000 tx=0x7f2cec03b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:46.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.227+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2cfc00ce30 con 0x7f2d04153a30 2024-01-27T14:59:46.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.227+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2cfc0583e0 con 0x7f2d04153a30 2024-01-27T14:59:46.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.405+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d040c7ab0 con 0x7f2ce406af20 2024-01-27T14:59:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.415+0000 7f2cfaffd640 1 -- 172.21.15.46:0/3314800307 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370892 (secure 0 0 0) 0x7f2d040c7ab0 con 0x7f2ce406af20 2024-01-27T14:59:46.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:46.422 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 msgr2=0x7f2ce406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 0x7f2ce406d3e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cec036000 tx=0x7f2cec03b040 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 msgr2=0x7f2d04158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b970 tx=0x7f2cfc00be30 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 shutdown_connections 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ce406af20 0x7f2ce406d3e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d040cd360 0x7f2d04158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d04153a30 0x7f2d04158e40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 --2- 172.21.15.46:0/3314800307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d0406c460 0x7f2d04150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 >> 172.21.15.46:0/3314800307 conn(0x7f2d0406a6c0 msgr2=0x7f2d040c3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 shutdown_connections 2024-01-27T14:59:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.418+0000 7f2d08943640 1 -- 172.21.15.46:0/3314800307 wait complete. 2024-01-27T14:59:46.431 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":872,"stamp":"2024-01-27T14:59:45.386295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15330,"ondisk_log_size":15330,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472000,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":389491,"kb_avail":754502720,"statfs":{"total":773094113280,"available":772610785280,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":398839345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66345,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":36,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003267"},"pg_stats":[{"pgid":"2.1f","version":"29'615","reported_seq":654,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.880144+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:59:17.880144+0000","last_peered":"2024-01-27T14:59:17.880144+0000","last_clean":"2024-01-27T14:59:17.880144+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:17.880144+0000","last_undegraded":"2024-01-27T14:59:17.880144+0000","last_fullsized":"2024-01-27T14:59:17.880144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050863+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:59:39.050863+0000","last_peered":"2024-01-27T14:59:39.050863+0000","last_clean":"2024-01-27T14:59:39.050863+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:59:39.050863+0000","last_undegraded":"2024-01-27T14:59:39.050863+0000","last_fullsized":"2024-01-27T14:59:39.050863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.823203+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:59:09.823203+0000","last_peered":"2024-01-27T14:59:09.823203+0000","last_clean":"2024-01-27T14:59:09.823203+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:59:09.823203+0000","last_undegraded":"2024-01-27T14:59:09.823203+0000","last_fullsized":"2024-01-27T14:59:09.823203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'728","reported_seq":769,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:54.356055+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:57:54.356055+0000","last_peered":"2024-01-27T14:57:54.356055+0000","last_clean":"2024-01-27T14:57:54.356055+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:57:54.356055+0000","last_undegraded":"2024-01-27T14:57:54.356055+0000","last_fullsized":"2024-01-27T14:57:54.356055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050337+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:59:39.050337+0000","last_peered":"2024-01-27T14:59:39.050337+0000","last_clean":"2024-01-27T14:59:39.050337+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:39.050337+0000","last_undegraded":"2024-01-27T14:59:39.050337+0000","last_fullsized":"2024-01-27T14:59:39.050337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.262122+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:59:08.262122+0000","last_peered":"2024-01-27T14:59:08.262122+0000","last_clean":"2024-01-27T14:59:08.262122+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:59:08.262122+0000","last_undegraded":"2024-01-27T14:59:08.262122+0000","last_fullsized":"2024-01-27T14:59:08.262122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1351","reported_seq":1389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.342958+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:59:28.342958+0000","last_peered":"2024-01-27T14:59:28.342958+0000","last_clean":"2024-01-27T14:59:28.342958+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:28.342958+0000","last_undegraded":"2024-01-27T14:59:28.342958+0000","last_fullsized":"2024-01-27T14:59:28.342958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061074+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:59:39.061074+0000","last_peered":"2024-01-27T14:59:39.061074+0000","last_clean":"2024-01-27T14:59:39.061074+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:39.061074+0000","last_undegraded":"2024-01-27T14:59:39.061074+0000","last_fullsized":"2024-01-27T14:59:39.061074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.920655+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:59:09.920655+0000","last_peered":"2024-01-27T14:59:09.920655+0000","last_clean":"2024-01-27T14:59:09.920655+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:59:09.920655+0000","last_undegraded":"2024-01-27T14:59:09.920655+0000","last_fullsized":"2024-01-27T14:59:09.920655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.282247+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:59:24.282247+0000","last_peered":"2024-01-27T14:59:24.282247+0000","last_clean":"2024-01-27T14:59:24.282247+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:24.282247+0000","last_undegraded":"2024-01-27T14:59:24.282247+0000","last_fullsized":"2024-01-27T14:59:24.282247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036097+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:59:39.036097+0000","last_peered":"2024-01-27T14:59:39.036097+0000","last_clean":"2024-01-27T14:59:39.036097+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:59:39.036097+0000","last_undegraded":"2024-01-27T14:59:39.036097+0000","last_fullsized":"2024-01-27T14:59:39.036097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.199421+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:59:08.199421+0000","last_peered":"2024-01-27T14:59:08.199421+0000","last_clean":"2024-01-27T14:59:08.199421+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:59:08.199421+0000","last_undegraded":"2024-01-27T14:59:08.199421+0000","last_fullsized":"2024-01-27T14:59:08.199421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.041694+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:59:39.041694+0000","last_peered":"2024-01-27T14:59:39.041694+0000","last_clean":"2024-01-27T14:59:39.041694+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:39.041694+0000","last_undegraded":"2024-01-27T14:59:39.041694+0000","last_fullsized":"2024-01-27T14:59:39.041694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'583","reported_seq":623,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.351839+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:59:25.351839+0000","last_peered":"2024-01-27T14:59:25.351839+0000","last_clean":"2024-01-27T14:59:25.351839+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:59:25.351839+0000","last_undegraded":"2024-01-27T14:59:25.351839+0000","last_fullsized":"2024-01-27T14:59:25.351839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.780557+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:59:09.780557+0000","last_peered":"2024-01-27T14:59:09.780557+0000","last_clean":"2024-01-27T14:59:09.780557+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:59:09.780557+0000","last_undegraded":"2024-01-27T14:59:09.780557+0000","last_fullsized":"2024-01-27T14:59:09.780557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046052+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:59:39.046052+0000","last_peered":"2024-01-27T14:59:39.046052+0000","last_clean":"2024-01-27T14:59:39.046052+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:59:39.046052+0000","last_undegraded":"2024-01-27T14:59:39.046052+0000","last_fullsized":"2024-01-27T14:59:39.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:53.272579+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:57:53.272579+0000","last_peered":"2024-01-27T14:57:53.272579+0000","last_clean":"2024-01-27T14:57:53.272579+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:57:53.272579+0000","last_undegraded":"2024-01-27T14:57:53.272579+0000","last_fullsized":"2024-01-27T14:57:53.272579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.960505+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:59:10.960505+0000","last_peered":"2024-01-27T14:59:10.960505+0000","last_clean":"2024-01-27T14:59:10.960505+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:59:10.960505+0000","last_undegraded":"2024-01-27T14:59:10.960505+0000","last_fullsized":"2024-01-27T14:59:10.960505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155851+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:59:39.155851+0000","last_peered":"2024-01-27T14:59:39.155851+0000","last_clean":"2024-01-27T14:59:39.155851+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:39.155851+0000","last_undegraded":"2024-01-27T14:59:39.155851+0000","last_fullsized":"2024-01-27T14:59:39.155851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.347476+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:59:25.347476+0000","last_peered":"2024-01-27T14:59:25.347476+0000","last_clean":"2024-01-27T14:59:25.347476+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:25.347476+0000","last_undegraded":"2024-01-27T14:59:25.347476+0000","last_fullsized":"2024-01-27T14:59:25.347476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.071002+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:59:08.071002+0000","last_peered":"2024-01-27T14:59:08.071002+0000","last_clean":"2024-01-27T14:59:08.071002+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:59:08.071002+0000","last_undegraded":"2024-01-27T14:59:08.071002+0000","last_fullsized":"2024-01-27T14:59:08.071002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.749392+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:59:09.749392+0000","last_peered":"2024-01-27T14:59:09.749392+0000","last_clean":"2024-01-27T14:59:09.749392+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:59:09.749392+0000","last_undegraded":"2024-01-27T14:59:09.749392+0000","last_fullsized":"2024-01-27T14:59:09.749392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:27.420001+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:59:27.420001+0000","last_peered":"2024-01-27T14:59:27.420001+0000","last_clean":"2024-01-27T14:59:27.420001+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:27.420001+0000","last_undegraded":"2024-01-27T14:59:27.420001+0000","last_fullsized":"2024-01-27T14:59:27.420001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.931840+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:59:10.931840+0000","last_peered":"2024-01-27T14:59:10.931840+0000","last_clean":"2024-01-27T14:59:10.931840+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:10.931840+0000","last_undegraded":"2024-01-27T14:59:10.931840+0000","last_fullsized":"2024-01-27T14:59:10.931840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155893+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:59:39.155893+0000","last_peered":"2024-01-27T14:59:39.155893+0000","last_clean":"2024-01-27T14:59:39.155893+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:59:39.155893+0000","last_undegraded":"2024-01-27T14:59:39.155893+0000","last_fullsized":"2024-01-27T14:59:39.155893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'14","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315901+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:59:31.315901+0000","last_peered":"2024-01-27T14:59:31.315901+0000","last_clean":"2024-01-27T14:59:31.315901+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:59:31.315901+0000","last_undegraded":"2024-01-27T14:59:31.315901+0000","last_fullsized":"2024-01-27T14:59:31.315901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.328213+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:59:08.328213+0000","last_peered":"2024-01-27T14:59:08.328213+0000","last_clean":"2024-01-27T14:59:08.328213+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:59:08.328213+0000","last_undegraded":"2024-01-27T14:59:08.328213+0000","last_fullsized":"2024-01-27T14:59:08.328213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157679+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:59:39.157679+0000","last_peered":"2024-01-27T14:59:39.157679+0000","last_clean":"2024-01-27T14:59:39.157679+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:59:39.157679+0000","last_undegraded":"2024-01-27T14:59:39.157679+0000","last_fullsized":"2024-01-27T14:59:39.157679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'316","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:34.094369+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:59:34.094369+0000","last_peered":"2024-01-27T14:59:34.094369+0000","last_clean":"2024-01-27T14:59:34.094369+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:34.094369+0000","last_undegraded":"2024-01-27T14:59:34.094369+0000","last_fullsized":"2024-01-27T14:59:34.094369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826340+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:59:09.826340+0000","last_peered":"2024-01-27T14:59:09.826340+0000","last_clean":"2024-01-27T14:59:09.826340+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:59:09.826340+0000","last_undegraded":"2024-01-27T14:59:09.826340+0000","last_fullsized":"2024-01-27T14:59:09.826340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022193+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:59:39.022193+0000","last_peered":"2024-01-27T14:59:39.022193+0000","last_clean":"2024-01-27T14:59:39.022193+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:59:39.022193+0000","last_undegraded":"2024-01-27T14:59:39.022193+0000","last_fullsized":"2024-01-27T14:59:39.022193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.316294+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:59:24.316294+0000","last_peered":"2024-01-27T14:59:24.316294+0000","last_clean":"2024-01-27T14:59:24.316294+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:59:24.316294+0000","last_undegraded":"2024-01-27T14:59:24.316294+0000","last_fullsized":"2024-01-27T14:59:24.316294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.167503+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:59:08.167503+0000","last_peered":"2024-01-27T14:59:08.167503+0000","last_clean":"2024-01-27T14:59:08.167503+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:59:08.167503+0000","last_undegraded":"2024-01-27T14:59:08.167503+0000","last_fullsized":"2024-01-27T14:59:08.167503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058740+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:59:39.058740+0000","last_peered":"2024-01-27T14:59:39.058740+0000","last_clean":"2024-01-27T14:59:39.058740+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:39.058740+0000","last_undegraded":"2024-01-27T14:59:39.058740+0000","last_fullsized":"2024-01-27T14:59:39.058740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:58:59.361308+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:58:59.361308+0000","last_peered":"2024-01-27T14:58:59.361308+0000","last_clean":"2024-01-27T14:58:59.361308+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:58:59.361308+0000","last_undegraded":"2024-01-27T14:58:59.361308+0000","last_fullsized":"2024-01-27T14:58:59.361308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.911629+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:59:09.911629+0000","last_peered":"2024-01-27T14:59:09.911629+0000","last_clean":"2024-01-27T14:59:09.911629+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:59:09.911629+0000","last_undegraded":"2024-01-27T14:59:09.911629+0000","last_fullsized":"2024-01-27T14:59:09.911629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.067394+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:59:39.067394+0000","last_peered":"2024-01-27T14:59:39.067394+0000","last_clean":"2024-01-27T14:59:39.067394+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:59:39.067394+0000","last_undegraded":"2024-01-27T14:59:39.067394+0000","last_fullsized":"2024-01-27T14:59:39.067394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'10","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.340212+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:59:25.340212+0000","last_peered":"2024-01-27T14:59:25.340212+0000","last_clean":"2024-01-27T14:59:25.340212+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:59:25.340212+0000","last_undegraded":"2024-01-27T14:59:25.340212+0000","last_fullsized":"2024-01-27T14:59:25.340212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.875622+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:59:10.875622+0000","last_peered":"2024-01-27T14:59:10.875622+0000","last_clean":"2024-01-27T14:59:10.875622+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:59:10.875622+0000","last_undegraded":"2024-01-27T14:59:10.875622+0000","last_fullsized":"2024-01-27T14:59:10.875622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049959+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:59:39.049959+0000","last_peered":"2024-01-27T14:59:39.049959+0000","last_clean":"2024-01-27T14:59:39.049959+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:59:39.049959+0000","last_undegraded":"2024-01-27T14:59:39.049959+0000","last_fullsized":"2024-01-27T14:59:39.049959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'934","reported_seq":1898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:36.353045+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:59:36.353045+0000","last_peered":"2024-01-27T14:59:36.353045+0000","last_clean":"2024-01-27T14:59:36.353045+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:36.353045+0000","last_undegraded":"2024-01-27T14:59:36.353045+0000","last_fullsized":"2024-01-27T14:59:36.353045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.790336+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:59:09.790336+0000","last_peered":"2024-01-27T14:59:09.790336+0000","last_clean":"2024-01-27T14:59:09.790336+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:59:09.790336+0000","last_undegraded":"2024-01-27T14:59:09.790336+0000","last_fullsized":"2024-01-27T14:59:09.790336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021770+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:59:39.021770+0000","last_peered":"2024-01-27T14:59:39.021770+0000","last_clean":"2024-01-27T14:59:39.021770+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:39.021770+0000","last_undegraded":"2024-01-27T14:59:39.021770+0000","last_fullsized":"2024-01-27T14:59:39.021770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'478","reported_seq":519,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.853827+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:59:15.853827+0000","last_peered":"2024-01-27T14:59:15.853827+0000","last_clean":"2024-01-27T14:59:15.853827+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:59:15.853827+0000","last_undegraded":"2024-01-27T14:59:15.853827+0000","last_fullsized":"2024-01-27T14:59:15.853827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":166,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.940972+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:59:10.940972+0000","last_peered":"2024-01-27T14:59:10.940972+0000","last_clean":"2024-01-27T14:59:10.940972+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:59:10.940972+0000","last_undegraded":"2024-01-27T14:59:10.940972+0000","last_fullsized":"2024-01-27T14:59:10.940972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.154667+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:59:39.154667+0000","last_peered":"2024-01-27T14:59:39.154667+0000","last_clean":"2024-01-27T14:59:39.154667+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:59:39.154667+0000","last_undegraded":"2024-01-27T14:59:39.154667+0000","last_fullsized":"2024-01-27T14:59:39.154667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'12","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315933+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:59:31.315933+0000","last_peered":"2024-01-27T14:59:31.315933+0000","last_clean":"2024-01-27T14:59:31.315933+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:59:31.315933+0000","last_undegraded":"2024-01-27T14:59:31.315933+0000","last_fullsized":"2024-01-27T14:59:31.315933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:39.292535+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:57:39.292535+0000","last_peered":"2024-01-27T14:57:39.292535+0000","last_clean":"2024-01-27T14:57:39.292535+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:57:39.292535+0000","last_undegraded":"2024-01-27T14:57:39.292535+0000","last_fullsized":"2024-01-27T14:57:39.292535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.317475+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:59:09.317475+0000","last_peered":"2024-01-27T14:59:09.317475+0000","last_clean":"2024-01-27T14:59:09.317475+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:59:09.317475+0000","last_undegraded":"2024-01-27T14:59:09.317475+0000","last_fullsized":"2024-01-27T14:59:09.317475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036199+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:59:39.036199+0000","last_peered":"2024-01-27T14:59:39.036199+0000","last_clean":"2024-01-27T14:59:39.036199+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:39.036199+0000","last_undegraded":"2024-01-27T14:59:39.036199+0000","last_fullsized":"2024-01-27T14:59:39.036199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.360055+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:59:32.360055+0000","last_peered":"2024-01-27T14:59:32.360055+0000","last_clean":"2024-01-27T14:59:32.360055+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:32.360055+0000","last_undegraded":"2024-01-27T14:59:32.360055+0000","last_fullsized":"2024-01-27T14:59:32.360055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.786852+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:59:10.786852+0000","last_peered":"2024-01-27T14:59:10.786852+0000","last_clean":"2024-01-27T14:59:10.786852+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:59:10.786852+0000","last_undegraded":"2024-01-27T14:59:10.786852+0000","last_fullsized":"2024-01-27T14:59:10.786852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124898+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:59:39.124898+0000","last_peered":"2024-01-27T14:59:39.124898+0000","last_clean":"2024-01-27T14:59:39.124898+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:59:39.124898+0000","last_undegraded":"2024-01-27T14:59:39.124898+0000","last_fullsized":"2024-01-27T14:59:39.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.320392+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:59:24.320392+0000","last_peered":"2024-01-27T14:59:24.320392+0000","last_clean":"2024-01-27T14:59:24.320392+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:24.320392+0000","last_undegraded":"2024-01-27T14:59:24.320392+0000","last_fullsized":"2024-01-27T14:59:24.320392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":213,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.599426+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:59:08.599426+0000","last_peered":"2024-01-27T14:59:08.599426+0000","last_clean":"2024-01-27T14:59:08.599426+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:59:08.599426+0000","last_undegraded":"2024-01-27T14:59:08.599426+0000","last_fullsized":"2024-01-27T14:59:08.599426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145584+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:59:39.145584+0000","last_peered":"2024-01-27T14:59:39.145584+0000","last_clean":"2024-01-27T14:59:39.145584+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:59:39.145584+0000","last_undegraded":"2024-01-27T14:59:39.145584+0000","last_fullsized":"2024-01-27T14:59:39.145584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:22.083460+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:59:22.083460+0000","last_peered":"2024-01-27T14:59:22.083460+0000","last_clean":"2024-01-27T14:59:22.083460+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:22.083460+0000","last_undegraded":"2024-01-27T14:59:22.083460+0000","last_fullsized":"2024-01-27T14:59:22.083460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.647605+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:59:08.647605+0000","last_peered":"2024-01-27T14:59:08.647605+0000","last_clean":"2024-01-27T14:59:08.647605+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:59:08.647605+0000","last_undegraded":"2024-01-27T14:59:08.647605+0000","last_fullsized":"2024-01-27T14:59:08.647605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051278+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:59:39.051278+0000","last_peered":"2024-01-27T14:59:39.051278+0000","last_clean":"2024-01-27T14:59:39.051278+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:39.051278+0000","last_undegraded":"2024-01-27T14:59:39.051278+0000","last_fullsized":"2024-01-27T14:59:39.051278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.843679+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:59:15.843679+0000","last_peered":"2024-01-27T14:59:15.843679+0000","last_clean":"2024-01-27T14:59:15.843679+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:15.843679+0000","last_undegraded":"2024-01-27T14:59:15.843679+0000","last_fullsized":"2024-01-27T14:59:15.843679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.364571+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:59:08.364571+0000","last_peered":"2024-01-27T14:59:08.364571+0000","last_clean":"2024-01-27T14:59:08.364571+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:08.364571+0000","last_undegraded":"2024-01-27T14:59:08.364571+0000","last_fullsized":"2024-01-27T14:59:08.364571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027341+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:59:39.027341+0000","last_peered":"2024-01-27T14:59:39.027341+0000","last_clean":"2024-01-27T14:59:39.027341+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:39.027341+0000","last_undegraded":"2024-01-27T14:59:39.027341+0000","last_fullsized":"2024-01-27T14:59:39.027341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.047429+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:59:20.047429+0000","last_peered":"2024-01-27T14:59:20.047429+0000","last_clean":"2024-01-27T14:59:20.047429+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:20.047429+0000","last_undegraded":"2024-01-27T14:59:20.047429+0000","last_fullsized":"2024-01-27T14:59:20.047429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826757+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:59:10.826757+0000","last_peered":"2024-01-27T14:59:10.826757+0000","last_clean":"2024-01-27T14:59:10.826757+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:59:10.826757+0000","last_undegraded":"2024-01-27T14:59:10.826757+0000","last_fullsized":"2024-01-27T14:59:10.826757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049463+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:59:39.049463+0000","last_peered":"2024-01-27T14:59:39.049463+0000","last_clean":"2024-01-27T14:59:39.049463+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:39.049463+0000","last_undegraded":"2024-01-27T14:59:39.049463+0000","last_fullsized":"2024-01-27T14:59:39.049463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:21.028639+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:59:21.028639+0000","last_peered":"2024-01-27T14:59:21.028639+0000","last_clean":"2024-01-27T14:59:21.028639+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:21.028639+0000","last_undegraded":"2024-01-27T14:59:21.028639+0000","last_fullsized":"2024-01-27T14:59:21.028639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":148,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.801323+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:59:10.801323+0000","last_peered":"2024-01-27T14:59:10.801323+0000","last_clean":"2024-01-27T14:59:10.801323+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:59:10.801323+0000","last_undegraded":"2024-01-27T14:59:10.801323+0000","last_fullsized":"2024-01-27T14:59:10.801323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.038975+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:59:39.038975+0000","last_peered":"2024-01-27T14:59:39.038975+0000","last_clean":"2024-01-27T14:59:39.038975+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:59:39.038975+0000","last_undegraded":"2024-01-27T14:59:39.038975+0000","last_fullsized":"2024-01-27T14:59:39.038975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'13","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315964+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:59:31.315964+0000","last_peered":"2024-01-27T14:59:31.315964+0000","last_clean":"2024-01-27T14:59:31.315964+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:59:31.315964+0000","last_undegraded":"2024-01-27T14:59:31.315964+0000","last_fullsized":"2024-01-27T14:59:31.315964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.246924+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:59:08.246924+0000","last_peered":"2024-01-27T14:59:08.246924+0000","last_clean":"2024-01-27T14:59:08.246924+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:59:08.246924+0000","last_undegraded":"2024-01-27T14:59:08.246924+0000","last_fullsized":"2024-01-27T14:59:08.246924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020881+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:59:39.020881+0000","last_peered":"2024-01-27T14:59:39.020881+0000","last_clean":"2024-01-27T14:59:39.020881+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.020881+0000","last_undegraded":"2024-01-27T14:59:39.020881+0000","last_fullsized":"2024-01-27T14:59:39.020881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'260","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.313960+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:59:39.313960+0000","last_peered":"2024-01-27T14:59:39.313960+0000","last_clean":"2024-01-27T14:59:39.313960+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:39.313960+0000","last_undegraded":"2024-01-27T14:59:39.313960+0000","last_fullsized":"2024-01-27T14:59:39.313960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:07.923827+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:59:07.923827+0000","last_peered":"2024-01-27T14:59:07.923827+0000","last_clean":"2024-01-27T14:59:07.923827+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:59:07.923827+0000","last_undegraded":"2024-01-27T14:59:07.923827+0000","last_fullsized":"2024-01-27T14:59:07.923827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124883+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:59:39.124883+0000","last_peered":"2024-01-27T14:59:39.124883+0000","last_clean":"2024-01-27T14:59:39.124883+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:59:39.124883+0000","last_undegraded":"2024-01-27T14:59:39.124883+0000","last_fullsized":"2024-01-27T14:59:39.124883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'829","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.293124+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:59:24.293124+0000","last_peered":"2024-01-27T14:59:24.293124+0000","last_clean":"2024-01-27T14:59:24.293124+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:24.293124+0000","last_undegraded":"2024-01-27T14:59:24.293124+0000","last_fullsized":"2024-01-27T14:59:24.293124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826629+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:59:09.826629+0000","last_peered":"2024-01-27T14:59:09.826629+0000","last_clean":"2024-01-27T14:59:09.826629+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:59:09.826629+0000","last_undegraded":"2024-01-27T14:59:09.826629+0000","last_fullsized":"2024-01-27T14:59:09.826629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.040394+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:59:39.040394+0000","last_peered":"2024-01-27T14:59:39.040394+0000","last_clean":"2024-01-27T14:59:39.040394+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:39.040394+0000","last_undegraded":"2024-01-27T14:59:39.040394+0000","last_fullsized":"2024-01-27T14:59:39.040394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'629","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.377338+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:59:32.377338+0000","last_peered":"2024-01-27T14:59:32.377338+0000","last_clean":"2024-01-27T14:59:32.377338+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:32.377338+0000","last_undegraded":"2024-01-27T14:59:32.377338+0000","last_fullsized":"2024-01-27T14:59:32.377338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.914090+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:59:09.914090+0000","last_peered":"2024-01-27T14:59:09.914090+0000","last_clean":"2024-01-27T14:59:09.914090+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:59:09.914090+0000","last_undegraded":"2024-01-27T14:59:09.914090+0000","last_fullsized":"2024-01-27T14:59:09.914090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.052297+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:59:39.052297+0000","last_peered":"2024-01-27T14:59:39.052297+0000","last_clean":"2024-01-27T14:59:39.052297+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:59:39.052297+0000","last_undegraded":"2024-01-27T14:59:39.052297+0000","last_fullsized":"2024-01-27T14:59:39.052297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.311314+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:59:31.311314+0000","last_peered":"2024-01-27T14:59:31.311314+0000","last_clean":"2024-01-27T14:59:31.311314+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:31.311314+0000","last_undegraded":"2024-01-27T14:59:31.311314+0000","last_fullsized":"2024-01-27T14:59:31.311314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.360645+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:59:08.360645+0000","last_peered":"2024-01-27T14:59:08.360645+0000","last_clean":"2024-01-27T14:59:08.360645+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:59:08.360645+0000","last_undegraded":"2024-01-27T14:59:08.360645+0000","last_fullsized":"2024-01-27T14:59:08.360645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065121+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:59:39.065121+0000","last_peered":"2024-01-27T14:59:39.065121+0000","last_clean":"2024-01-27T14:59:39.065121+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:39.065121+0000","last_undegraded":"2024-01-27T14:59:39.065121+0000","last_fullsized":"2024-01-27T14:59:39.065121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'17","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:38.839260+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:59:38.839260+0000","last_peered":"2024-01-27T14:59:38.839260+0000","last_clean":"2024-01-27T14:59:38.839260+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:38.839260+0000","last_undegraded":"2024-01-27T14:59:38.839260+0000","last_fullsized":"2024-01-27T14:59:38.839260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.861248+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:59:10.861248+0000","last_peered":"2024-01-27T14:59:10.861248+0000","last_clean":"2024-01-27T14:59:10.861248+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:59:10.861248+0000","last_undegraded":"2024-01-27T14:59:10.861248+0000","last_fullsized":"2024-01-27T14:59:10.861248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989182+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:59:10.989182+0000","last_peered":"2024-01-27T14:59:10.989182+0000","last_clean":"2024-01-27T14:59:10.989182+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:59:10.989182+0000","last_undegraded":"2024-01-27T14:59:10.989182+0000","last_fullsized":"2024-01-27T14:59:10.989182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.159992+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:59:39.159992+0000","last_peered":"2024-01-27T14:59:39.159992+0000","last_clean":"2024-01-27T14:59:39.159992+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:39.159992+0000","last_undegraded":"2024-01-27T14:59:39.159992+0000","last_fullsized":"2024-01-27T14:59:39.159992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.861159+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:59:17.861159+0000","last_peered":"2024-01-27T14:59:17.861159+0000","last_clean":"2024-01-27T14:59:17.861159+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:59:17.861159+0000","last_undegraded":"2024-01-27T14:59:17.861159+0000","last_fullsized":"2024-01-27T14:59:17.861159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.930556+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:59:09.930556+0000","last_peered":"2024-01-27T14:59:09.930556+0000","last_clean":"2024-01-27T14:59:09.930556+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:59:09.930556+0000","last_undegraded":"2024-01-27T14:59:09.930556+0000","last_fullsized":"2024-01-27T14:59:09.930556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048755+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:59:39.048755+0000","last_peered":"2024-01-27T14:59:39.048755+0000","last_clean":"2024-01-27T14:59:39.048755+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:59:39.048755+0000","last_undegraded":"2024-01-27T14:59:39.048755+0000","last_fullsized":"2024-01-27T14:59:39.048755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.046360+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:59:20.046360+0000","last_peered":"2024-01-27T14:59:20.046360+0000","last_clean":"2024-01-27T14:59:20.046360+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:20.046360+0000","last_undegraded":"2024-01-27T14:59:20.046360+0000","last_fullsized":"2024-01-27T14:59:20.046360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'660","reported_seq":699,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:30.373035+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:59:30.373035+0000","last_peered":"2024-01-27T14:59:30.373035+0000","last_clean":"2024-01-27T14:59:30.373035+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:59:30.373035+0000","last_undegraded":"2024-01-27T14:59:30.373035+0000","last_fullsized":"2024-01-27T14:59:30.373035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157899+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:59:39.157899+0000","last_peered":"2024-01-27T14:59:39.157899+0000","last_clean":"2024-01-27T14:59:39.157899+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:59:39.157899+0000","last_undegraded":"2024-01-27T14:59:39.157899+0000","last_fullsized":"2024-01-27T14:59:39.157899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989218+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:59:10.989218+0000","last_peered":"2024-01-27T14:59:10.989218+0000","last_clean":"2024-01-27T14:59:10.989218+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:59:10.989218+0000","last_undegraded":"2024-01-27T14:59:10.989218+0000","last_fullsized":"2024-01-27T14:59:10.989218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.362004+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:59:29.362004+0000","last_peered":"2024-01-27T14:59:29.362004+0000","last_clean":"2024-01-27T14:59:29.362004+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:29.362004+0000","last_undegraded":"2024-01-27T14:59:29.362004+0000","last_fullsized":"2024-01-27T14:59:29.362004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.057195+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:59:39.057195+0000","last_peered":"2024-01-27T14:59:39.057195+0000","last_clean":"2024-01-27T14:59:39.057195+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:39.057195+0000","last_undegraded":"2024-01-27T14:59:39.057195+0000","last_fullsized":"2024-01-27T14:59:39.057195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.799454+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:59:10.799454+0000","last_peered":"2024-01-27T14:59:10.799454+0000","last_clean":"2024-01-27T14:59:10.799454+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:59:10.799454+0000","last_undegraded":"2024-01-27T14:59:10.799454+0000","last_fullsized":"2024-01-27T14:59:10.799454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.062850+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:59:39.062850+0000","last_peered":"2024-01-27T14:59:39.062850+0000","last_clean":"2024-01-27T14:59:39.062850+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:39.062850+0000","last_undegraded":"2024-01-27T14:59:39.062850+0000","last_fullsized":"2024-01-27T14:59:39.062850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.045705+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:59:39.045705+0000","last_peered":"2024-01-27T14:59:39.045705+0000","last_clean":"2024-01-27T14:59:39.045705+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:39.045705+0000","last_undegraded":"2024-01-27T14:59:39.045705+0000","last_fullsized":"2024-01-27T14:59:39.045705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022545+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:59:39.022545+0000","last_peered":"2024-01-27T14:59:39.022545+0000","last_clean":"2024-01-27T14:59:39.022545+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:39.022545+0000","last_undegraded":"2024-01-27T14:59:39.022545+0000","last_fullsized":"2024-01-27T14:59:39.022545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051601+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:59:39.051601+0000","last_peered":"2024-01-27T14:59:39.051601+0000","last_clean":"2024-01-27T14:59:39.051601+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:39.051601+0000","last_undegraded":"2024-01-27T14:59:39.051601+0000","last_fullsized":"2024-01-27T14:59:39.051601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021084+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:59:39.021084+0000","last_peered":"2024-01-27T14:59:39.021084+0000","last_clean":"2024-01-27T14:59:39.021084+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:59:39.021084+0000","last_undegraded":"2024-01-27T14:59:39.021084+0000","last_fullsized":"2024-01-27T14:59:39.021084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.019956+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:59:39.019956+0000","last_peered":"2024-01-27T14:59:39.019956+0000","last_clean":"2024-01-27T14:59:39.019956+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:59:39.019956+0000","last_undegraded":"2024-01-27T14:59:39.019956+0000","last_fullsized":"2024-01-27T14:59:39.019956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061185+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:59:39.061185+0000","last_peered":"2024-01-27T14:59:39.061185+0000","last_clean":"2024-01-27T14:59:39.061185+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:39.061185+0000","last_undegraded":"2024-01-27T14:59:39.061185+0000","last_fullsized":"2024-01-27T14:59:39.061185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.047267+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:59:39.047267+0000","last_peered":"2024-01-27T14:59:39.047267+0000","last_clean":"2024-01-27T14:59:39.047267+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:59:39.047267+0000","last_undegraded":"2024-01-27T14:59:39.047267+0000","last_fullsized":"2024-01-27T14:59:39.047267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.030949+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:59:39.030949+0000","last_peered":"2024-01-27T14:59:39.030949+0000","last_clean":"2024-01-27T14:59:39.030949+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:39.030949+0000","last_undegraded":"2024-01-27T14:59:39.030949+0000","last_fullsized":"2024-01-27T14:59:39.030949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050100+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:59:39.050100+0000","last_peered":"2024-01-27T14:59:39.050100+0000","last_clean":"2024-01-27T14:59:39.050100+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:59:39.050100+0000","last_undegraded":"2024-01-27T14:59:39.050100+0000","last_fullsized":"2024-01-27T14:59:39.050100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058983+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:59:39.058983+0000","last_peered":"2024-01-27T14:59:39.058983+0000","last_clean":"2024-01-27T14:59:39.058983+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.058983+0000","last_undegraded":"2024-01-27T14:59:39.058983+0000","last_fullsized":"2024-01-27T14:59:39.058983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157835+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:59:39.157835+0000","last_peered":"2024-01-27T14:59:39.157835+0000","last_clean":"2024-01-27T14:59:39.157835+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:39.157835+0000","last_undegraded":"2024-01-27T14:59:39.157835+0000","last_fullsized":"2024-01-27T14:59:39.157835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145636+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:59:39.145636+0000","last_peered":"2024-01-27T14:59:39.145636+0000","last_clean":"2024-01-27T14:59:39.145636+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:59:39.145636+0000","last_undegraded":"2024-01-27T14:59:39.145636+0000","last_fullsized":"2024-01-27T14:59:39.145636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.023696+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:59:39.023696+0000","last_peered":"2024-01-27T14:59:39.023696+0000","last_clean":"2024-01-27T14:59:39.023696+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:59:39.023696+0000","last_undegraded":"2024-01-27T14:59:39.023696+0000","last_fullsized":"2024-01-27T14:59:39.023696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048100+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:59:39.048100+0000","last_peered":"2024-01-27T14:59:39.048100+0000","last_clean":"2024-01-27T14:59:39.048100+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:59:39.048100+0000","last_undegraded":"2024-01-27T14:59:39.048100+0000","last_fullsized":"2024-01-27T14:59:39.048100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027716+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:59:39.027716+0000","last_peered":"2024-01-27T14:59:39.027716+0000","last_clean":"2024-01-27T14:59:39.027716+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:59:39.027716+0000","last_undegraded":"2024-01-27T14:59:39.027716+0000","last_fullsized":"2024-01-27T14:59:39.027716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.028460+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:59:39.028460+0000","last_peered":"2024-01-27T14:59:39.028460+0000","last_clean":"2024-01-27T14:59:39.028460+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:39.028460+0000","last_undegraded":"2024-01-27T14:59:39.028460+0000","last_fullsized":"2024-01-27T14:59:39.028460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046375+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:59:39.046375+0000","last_peered":"2024-01-27T14:59:39.046375+0000","last_clean":"2024-01-27T14:59:39.046375+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:39.046375+0000","last_undegraded":"2024-01-27T14:59:39.046375+0000","last_fullsized":"2024-01-27T14:59:39.046375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020810+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:59:39.020810+0000","last_peered":"2024-01-27T14:59:39.020810+0000","last_clean":"2024-01-27T14:59:39.020810+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:59:39.020810+0000","last_undegraded":"2024-01-27T14:59:39.020810+0000","last_fullsized":"2024-01-27T14:59:39.020810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020831+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:59:39.020831+0000","last_peered":"2024-01-27T14:59:39.020831+0000","last_clean":"2024-01-27T14:59:39.020831+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:39.020831+0000","last_undegraded":"2024-01-27T14:59:39.020831+0000","last_fullsized":"2024-01-27T14:59:39.020831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.146288+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:59:39.146288+0000","last_peered":"2024-01-27T14:59:39.146288+0000","last_clean":"2024-01-27T14:59:39.146288+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:39.146288+0000","last_undegraded":"2024-01-27T14:59:39.146288+0000","last_fullsized":"2024-01-27T14:59:39.146288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129537+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:59:39.129537+0000","last_peered":"2024-01-27T14:59:39.129537+0000","last_clean":"2024-01-27T14:59:39.129537+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:39.129537+0000","last_undegraded":"2024-01-27T14:59:39.129537+0000","last_fullsized":"2024-01-27T14:59:39.129537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148552+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:59:39.148552+0000","last_peered":"2024-01-27T14:59:39.148552+0000","last_clean":"2024-01-27T14:59:39.148552+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:39.148552+0000","last_undegraded":"2024-01-27T14:59:39.148552+0000","last_fullsized":"2024-01-27T14:59:39.148552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058014+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:59:39.058014+0000","last_peered":"2024-01-27T14:59:39.058014+0000","last_clean":"2024-01-27T14:59:39.058014+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:39.058014+0000","last_undegraded":"2024-01-27T14:59:39.058014+0000","last_fullsized":"2024-01-27T14:59:39.058014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050038+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:59:39.050038+0000","last_peered":"2024-01-27T14:59:39.050038+0000","last_clean":"2024-01-27T14:59:39.050038+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:59:39.050038+0000","last_undegraded":"2024-01-27T14:59:39.050038+0000","last_fullsized":"2024-01-27T14:59:39.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065671+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:59:39.065671+0000","last_peered":"2024-01-27T14:59:39.065671+0000","last_clean":"2024-01-27T14:59:39.065671+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:59:39.065671+0000","last_undegraded":"2024-01-27T14:59:39.065671+0000","last_fullsized":"2024-01-27T14:59:39.065671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.055089+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:59:39.055089+0000","last_peered":"2024-01-27T14:59:39.055089+0000","last_clean":"2024-01-27T14:59:39.055089+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:39.055089+0000","last_undegraded":"2024-01-27T14:59:39.055089+0000","last_fullsized":"2024-01-27T14:59:39.055089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050346+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:59:39.050346+0000","last_peered":"2024-01-27T14:59:39.050346+0000","last_clean":"2024-01-27T14:59:39.050346+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:59:39.050346+0000","last_undegraded":"2024-01-27T14:59:39.050346+0000","last_fullsized":"2024-01-27T14:59:39.050346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065975+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:59:39.065975+0000","last_peered":"2024-01-27T14:59:39.065975+0000","last_clean":"2024-01-27T14:59:39.065975+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:39.065975+0000","last_undegraded":"2024-01-27T14:59:39.065975+0000","last_fullsized":"2024-01-27T14:59:39.065975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048739+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:59:39.048739+0000","last_peered":"2024-01-27T14:59:39.048739+0000","last_clean":"2024-01-27T14:59:39.048739+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:39.048739+0000","last_undegraded":"2024-01-27T14:59:39.048739+0000","last_fullsized":"2024-01-27T14:59:39.048739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.037581+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:59:39.037581+0000","last_peered":"2024-01-27T14:59:39.037581+0000","last_clean":"2024-01-27T14:59:39.037581+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:59:39.037581+0000","last_undegraded":"2024-01-27T14:59:39.037581+0000","last_fullsized":"2024-01-27T14:59:39.037581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.111454+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:59:39.111454+0000","last_peered":"2024-01-27T14:59:39.111454+0000","last_clean":"2024-01-27T14:59:39.111454+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:39.111454+0000","last_undegraded":"2024-01-27T14:59:39.111454+0000","last_fullsized":"2024-01-27T14:59:39.111454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509783,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.58399999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.41699999999999998},"min":{"1min":0.32100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65200000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.434},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.80100000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60799999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.442,"15min":0.441},"min":{"1min":0.33000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.54000000000000004,"5min":0.64200000000000002,"15min":0.66100000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.44600000000000001,"5min":0.60499999999999998,"15min":0.76900000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.55800000000000005,"15min":0.621},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.46600000000000003,"5min":0.54000000000000004,"15min":0.59899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509783,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.58199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.67100000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.64000000000000001},"last":0.62},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66500000000000004},"last":0.63}]},{"osd":3,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.65500000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61899999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.44},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.71999999999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.58599999999999997},"last":0.38800000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.441,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46899999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.19,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.495,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.312},"min":{"1min":0.20899999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.437,"5min":0.47099999999999997,"15min":0.57499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.373,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52500000000000002,"15min":0.68200000000000005},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.53700000000000003,"15min":0.64800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.378},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.72499999999999998},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.432,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.71599999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.71899999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.66200000000000003,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.753},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.41599999999999998,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.78000000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.39100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66400000000000003,"5min":0.67600000000000005,"15min":0.79500000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.75600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.502,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.59399999999999997,"5min":0.73199999999999998,"15min":0.76000000000000001},"last":0.65200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.28599999999999998,"15min":0.28999999999999998},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.375,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":0.58499999999999996,"15min":0.59699999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27300000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.42699999999999999,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.313},"max":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.442,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.65700000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54800000000000004,"5min":0.752,"15min":0.752},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.51800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.191},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.502}]},{"osd":3,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.62},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.248},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.747},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.28999999999999998},"max":{"1min":0.628,"5min":0.872,"15min":0.872},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509782,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":0.45700000000000002,"5min":0.47699999999999998,"15min":0.53700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.315},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.55000000000000004,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.61399999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.192,"15min":0.192},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.224},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.80700000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.63800000000000001,"15min":0.79500000000000004},"last":0.499}]},{"osd":5,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.68600000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.497,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.70599999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.61599999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.23699999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.313,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.68700000000000006},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.51800000000000002,"5min":0.64800000000000002,"15min":0.66100000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59899999999999998,"5min":0.63800000000000001,"15min":0.68899999999999995},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.63300000000000001,"15min":0.63800000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.67400000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Jan 27 14:59:10 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.621},"last":0.501},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51700000000000002,"5min":0.59799999999999998,"15min":0.625},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.65600000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.628}]}]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.501}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:59:46.437 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-27T14:59:46.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:59:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 Processor -- start 2024-01-27T14:59:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 -- start start 2024-01-27T14:59:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 0x7f2ef40cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ef40c9da0 0x7f2ef40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef4153f60 con 0x7f2ef4153b80 2024-01-27T14:59:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40ca6f0 con 0x7f2ef40c6660 2024-01-27T14:59:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.572+0000 7f2efb5b0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40cb190 con 0x7f2ef40c9da0 2024-01-27T14:59:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.573+0000 7f2ef8b4b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 0x7f2ef40cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.573+0000 7f2ef9b4d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ef40c9da0 0x7f2ef40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.573+0000 7f2ef8b4b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 0x7f2ef40cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33734/0 (socket says 172.21.15.46:33734) 2024-01-27T14:59:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.573+0000 7f2ef8b4b640 1 -- 172.21.15.46:0/450710235 learned_addr learned my addr 172.21.15.46:0/450710235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.576+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/450710235 >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 msgr2=0x7f2ef40cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.576+0000 7f2ef9b4d640 1 --2- 172.21.15.46:0/450710235 >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 0x7f2ef40cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.576+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/450710235 >> v1:172.21.15.73:6789/0 conn(0x7f2ef4153b80 legacy=0x7f2ef41597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.576+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/450710235 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef415dc90 con 0x7f2ef40c9da0 2024-01-27T14:59:46.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.581+0000 7f2ef9b4d640 1 --2- 172.21.15.46:0/450710235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef40ca1b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40c65d0 tx=0x7f2eec02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57132849f95d33a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:46.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.585+0000 7f2eebfff640 1 -- 172.21.15.46:0/450710235 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec02cc80 con 0x7f2ef40c9da0 2024-01-27T14:59:46.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.585+0000 7f2eebfff640 1 -- 172.21.15.46:0/450710235 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec02cde0 con 0x7f2ef40c9da0 2024-01-27T14:59:46.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.585+0000 7f2eebfff640 1 -- 172.21.15.46:0/450710235 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec034660 con 0x7f2ef40c9da0 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 -- 172.21.15.46:0/450710235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 msgr2=0x7f2ef40ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/450710235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef40ca1b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40c65d0 tx=0x7f2eec02bed0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 -- 172.21.15.46:0/450710235 shutdown_connections 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/450710235 >> v2:172.21.15.46:3300/0 conn(0x7f2ef40c6660 0x7f2ef40cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/450710235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef40ca1b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 -- 172.21.15.46:0/450710235 >> 172.21.15.46:0/450710235 conn(0x7f2ef4071df0 msgr2=0x7f2ef4072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 -- 172.21.15.46:0/450710235 shutdown_connections 2024-01-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.586+0000 7f2efb5b0640 1 -- 172.21.15.46:0/450710235 wait complete. 2024-01-27T14:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.587+0000 7f2efb5b0640 1 Processor -- start 2024-01-27T14:59:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.587+0000 7f2efb5b0640 1 -- start start 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ef40c6660 0x7f2ef4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef4156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41ef120 con 0x7f2ef4153b80 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40c3ec0 con 0x7f2ef40c9da0 2024-01-27T14:59:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2efb5b0640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41547b0 con 0x7f2ef40c6660 2024-01-27T14:59:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2ef9b4d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.588+0000 7f2ef934c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ef40c6660 0x7f2ef4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.589+0000 7f2ef8b4b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef4156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.589+0000 7f2ef9b4d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33750/0 (socket says 172.21.15.46:33750) 2024-01-27T14:59:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.589+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/1241608095 learned_addr learned my addr 172.21.15.46:0/1241608095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.592+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ef40c6660 msgr2=0x7f2ef4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.592+0000 7f2ef9b4d640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ef40c6660 0x7f2ef4154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.592+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 msgr2=0x7f2ef4156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.592+0000 7f2ef9b4d640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef4156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:46.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.592+0000 7f2ef9b4d640 1 -- 172.21.15.46:0/1241608095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009a70 con 0x7f2ef4153b80 2024-01-27T14:59:46.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.594+0000 7f2ef9b4d640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009e50 tx=0x7f2eec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:46.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.598+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec03e600 con 0x7f2ef4153b80 2024-01-27T14:59:46.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.598+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec03e760 con 0x7f2ef4153b80 2024-01-27T14:59:46.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.598+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec03eb10 con 0x7f2ef4153b80 2024-01-27T14:59:46.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.598+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef415d740 con 0x7f2ef4153b80 2024-01-27T14:59:46.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.598+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40c3900 con 0x7f2ef4153b80 2024-01-27T14:59:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.599+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef40cbee0 con 0x7f2ef4153b80 2024-01-27T14:59:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.619+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2eec03ec70 con 0x7f2ef4153b80 2024-01-27T14:59:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.619+0000 7f2ee9ffb640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 0x7f2ed806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.620+0000 7f2ef934c640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 0x7f2ed806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.620+0000 7f2ef934c640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 0x7f2ed806d3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00016e0 tx=0x7f2ef0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:46.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.881+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2eec07b260 con 0x7f2ef4153b80 2024-01-27T14:59:46.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:46.881+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2eec0775a0 con 0x7f2ef4153b80 2024-01-27T14:59:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.063+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ef415d1b0 con 0x7f2ed806af20 2024-01-27T14:59:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.072+0000 7f2ee9ffb640 1 -- 172.21.15.46:0/1241608095 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370892 (secure 0 0 0) 0x7f2ef0001cc0 con 0x7f2ed806af20 2024-01-27T14:59:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:47.082 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:59:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.075+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 msgr2=0x7f2ed806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.075+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 0x7f2ed806d3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00016e0 tx=0x7f2ef0009040 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 msgr2=0x7f2ef40c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009e50 tx=0x7f2eec004a40 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 shutdown_connections 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2ed806af20 0x7f2ed806d3e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef40c9da0 0x7f2ef4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef4153b80 0x7f2ef40c0be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 --2- 172.21.15.46:0/1241608095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ef40c6660 0x7f2ef4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 >> 172.21.15.46:0/1241608095 conn(0x7f2ef4071df0 msgr2=0x7f2ef40ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 shutdown_connections 2024-01-27T14:59:47.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.076+0000 7f2efb5b0640 1 -- 172.21.15.46:0/1241608095 wait complete. 2024-01-27T14:59:47.089 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":872,"stamp":"2024-01-27T14:59:45.386295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15330,"ondisk_log_size":15330,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472000,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":389491,"kb_avail":754502720,"statfs":{"total":773094113280,"available":772610785280,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":398839345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66345,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":36,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003267"},"pg_stats":[{"pgid":"2.1f","version":"29'615","reported_seq":654,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.880144+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:59:17.880144+0000","last_peered":"2024-01-27T14:59:17.880144+0000","last_clean":"2024-01-27T14:59:17.880144+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:17.880144+0000","last_undegraded":"2024-01-27T14:59:17.880144+0000","last_fullsized":"2024-01-27T14:59:17.880144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:17:45.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050863+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:59:39.050863+0000","last_peered":"2024-01-27T14:59:39.050863+0000","last_clean":"2024-01-27T14:59:39.050863+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:59:39.050863+0000","last_undegraded":"2024-01-27T14:59:39.050863+0000","last_fullsized":"2024-01-27T14:59:39.050863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.823203+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:59:09.823203+0000","last_peered":"2024-01-27T14:59:09.823203+0000","last_clean":"2024-01-27T14:59:09.823203+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:59:09.823203+0000","last_undegraded":"2024-01-27T14:59:09.823203+0000","last_fullsized":"2024-01-27T14:59:09.823203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'728","reported_seq":769,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:54.356055+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:57:54.356055+0000","last_peered":"2024-01-27T14:57:54.356055+0000","last_clean":"2024-01-27T14:57:54.356055+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:57:54.356055+0000","last_undegraded":"2024-01-27T14:57:54.356055+0000","last_fullsized":"2024-01-27T14:57:54.356055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050337+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:59:39.050337+0000","last_peered":"2024-01-27T14:59:39.050337+0000","last_clean":"2024-01-27T14:59:39.050337+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:39.050337+0000","last_undegraded":"2024-01-27T14:59:39.050337+0000","last_fullsized":"2024-01-27T14:59:39.050337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.262122+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:59:08.262122+0000","last_peered":"2024-01-27T14:59:08.262122+0000","last_clean":"2024-01-27T14:59:08.262122+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:59:08.262122+0000","last_undegraded":"2024-01-27T14:59:08.262122+0000","last_fullsized":"2024-01-27T14:59:08.262122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:39.822308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1351","reported_seq":1389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.342958+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:59:28.342958+0000","last_peered":"2024-01-27T14:59:28.342958+0000","last_clean":"2024-01-27T14:59:28.342958+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:28.342958+0000","last_undegraded":"2024-01-27T14:59:28.342958+0000","last_fullsized":"2024-01-27T14:59:28.342958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061074+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:59:39.061074+0000","last_peered":"2024-01-27T14:59:39.061074+0000","last_clean":"2024-01-27T14:59:39.061074+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:39.061074+0000","last_undegraded":"2024-01-27T14:59:39.061074+0000","last_fullsized":"2024-01-27T14:59:39.061074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.920655+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:59:09.920655+0000","last_peered":"2024-01-27T14:59:09.920655+0000","last_clean":"2024-01-27T14:59:09.920655+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:59:09.920655+0000","last_undegraded":"2024-01-27T14:59:09.920655+0000","last_fullsized":"2024-01-27T14:59:09.920655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:59.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.282247+0000","last_change":"2024-01-27T14:31:50.741290+0000","last_active":"2024-01-27T14:59:24.282247+0000","last_peered":"2024-01-27T14:59:24.282247+0000","last_clean":"2024-01-27T14:59:24.282247+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:24.282247+0000","last_undegraded":"2024-01-27T14:59:24.282247+0000","last_fullsized":"2024-01-27T14:59:24.282247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036097+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:59:39.036097+0000","last_peered":"2024-01-27T14:59:39.036097+0000","last_clean":"2024-01-27T14:59:39.036097+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:59:39.036097+0000","last_undegraded":"2024-01-27T14:59:39.036097+0000","last_fullsized":"2024-01-27T14:59:39.036097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:51.616281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.199421+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:59:08.199421+0000","last_peered":"2024-01-27T14:59:08.199421+0000","last_clean":"2024-01-27T14:59:08.199421+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:59:08.199421+0000","last_undegraded":"2024-01-27T14:59:08.199421+0000","last_fullsized":"2024-01-27T14:59:08.199421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:19.592420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.041694+0000","last_change":"2024-01-27T14:31:51.993117+0000","last_active":"2024-01-27T14:59:39.041694+0000","last_peered":"2024-01-27T14:59:39.041694+0000","last_clean":"2024-01-27T14:59:39.041694+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:39.041694+0000","last_undegraded":"2024-01-27T14:59:39.041694+0000","last_fullsized":"2024-01-27T14:59:39.041694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:03:23.916880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'583","reported_seq":623,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.351839+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:59:25.351839+0000","last_peered":"2024-01-27T14:59:25.351839+0000","last_clean":"2024-01-27T14:59:25.351839+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:59:25.351839+0000","last_undegraded":"2024-01-27T14:59:25.351839+0000","last_fullsized":"2024-01-27T14:59:25.351839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:48.177081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.780557+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:59:09.780557+0000","last_peered":"2024-01-27T14:59:09.780557+0000","last_clean":"2024-01-27T14:59:09.780557+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:59:09.780557+0000","last_undegraded":"2024-01-27T14:59:09.780557+0000","last_fullsized":"2024-01-27T14:59:09.780557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:11.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046052+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:59:39.046052+0000","last_peered":"2024-01-27T14:59:39.046052+0000","last_clean":"2024-01-27T14:59:39.046052+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:59:39.046052+0000","last_undegraded":"2024-01-27T14:59:39.046052+0000","last_fullsized":"2024-01-27T14:59:39.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:53.272579+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:57:53.272579+0000","last_peered":"2024-01-27T14:57:53.272579+0000","last_clean":"2024-01-27T14:57:53.272579+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:57:53.272579+0000","last_undegraded":"2024-01-27T14:57:53.272579+0000","last_fullsized":"2024-01-27T14:57:53.272579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.960505+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:59:10.960505+0000","last_peered":"2024-01-27T14:59:10.960505+0000","last_clean":"2024-01-27T14:59:10.960505+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:59:10.960505+0000","last_undegraded":"2024-01-27T14:59:10.960505+0000","last_fullsized":"2024-01-27T14:59:10.960505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155851+0000","last_change":"2024-01-27T14:31:52.006787+0000","last_active":"2024-01-27T14:59:39.155851+0000","last_peered":"2024-01-27T14:59:39.155851+0000","last_clean":"2024-01-27T14:59:39.155851+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:39.155851+0000","last_undegraded":"2024-01-27T14:59:39.155851+0000","last_fullsized":"2024-01-27T14:59:39.155851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.347476+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:59:25.347476+0000","last_peered":"2024-01-27T14:59:25.347476+0000","last_clean":"2024-01-27T14:59:25.347476+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:25.347476+0000","last_undegraded":"2024-01-27T14:59:25.347476+0000","last_fullsized":"2024-01-27T14:59:25.347476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.071002+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:59:08.071002+0000","last_peered":"2024-01-27T14:59:08.071002+0000","last_clean":"2024-01-27T14:59:08.071002+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:59:08.071002+0000","last_undegraded":"2024-01-27T14:59:08.071002+0000","last_fullsized":"2024-01-27T14:59:08.071002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.749392+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:59:09.749392+0000","last_peered":"2024-01-27T14:59:09.749392+0000","last_clean":"2024-01-27T14:59:09.749392+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:59:09.749392+0000","last_undegraded":"2024-01-27T14:59:09.749392+0000","last_fullsized":"2024-01-27T14:59:09.749392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:11:30.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:27.420001+0000","last_change":"2024-01-27T14:31:50.741322+0000","last_active":"2024-01-27T14:59:27.420001+0000","last_peered":"2024-01-27T14:59:27.420001+0000","last_clean":"2024-01-27T14:59:27.420001+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:27.420001+0000","last_undegraded":"2024-01-27T14:59:27.420001+0000","last_fullsized":"2024-01-27T14:59:27.420001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.931840+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:59:10.931840+0000","last_peered":"2024-01-27T14:59:10.931840+0000","last_clean":"2024-01-27T14:59:10.931840+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:10.931840+0000","last_undegraded":"2024-01-27T14:59:10.931840+0000","last_fullsized":"2024-01-27T14:59:10.931840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:44.574856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.155893+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:59:39.155893+0000","last_peered":"2024-01-27T14:59:39.155893+0000","last_clean":"2024-01-27T14:59:39.155893+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:59:39.155893+0000","last_undegraded":"2024-01-27T14:59:39.155893+0000","last_fullsized":"2024-01-27T14:59:39.155893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'14","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315901+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:59:31.315901+0000","last_peered":"2024-01-27T14:59:31.315901+0000","last_clean":"2024-01-27T14:59:31.315901+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:59:31.315901+0000","last_undegraded":"2024-01-27T14:59:31.315901+0000","last_fullsized":"2024-01-27T14:59:31.315901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:26:09.980996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.328213+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:59:08.328213+0000","last_peered":"2024-01-27T14:59:08.328213+0000","last_clean":"2024-01-27T14:59:08.328213+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:59:08.328213+0000","last_undegraded":"2024-01-27T14:59:08.328213+0000","last_fullsized":"2024-01-27T14:59:08.328213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:45.148268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157679+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:59:39.157679+0000","last_peered":"2024-01-27T14:59:39.157679+0000","last_clean":"2024-01-27T14:59:39.157679+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:59:39.157679+0000","last_undegraded":"2024-01-27T14:59:39.157679+0000","last_fullsized":"2024-01-27T14:59:39.157679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:14:40.283439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'316","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:34.094369+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:59:34.094369+0000","last_peered":"2024-01-27T14:59:34.094369+0000","last_clean":"2024-01-27T14:59:34.094369+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:34.094369+0000","last_undegraded":"2024-01-27T14:59:34.094369+0000","last_fullsized":"2024-01-27T14:59:34.094369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:00:01.002999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826340+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:59:09.826340+0000","last_peered":"2024-01-27T14:59:09.826340+0000","last_clean":"2024-01-27T14:59:09.826340+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:59:09.826340+0000","last_undegraded":"2024-01-27T14:59:09.826340+0000","last_fullsized":"2024-01-27T14:59:09.826340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022193+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:59:39.022193+0000","last_peered":"2024-01-27T14:59:39.022193+0000","last_clean":"2024-01-27T14:59:39.022193+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:59:39.022193+0000","last_undegraded":"2024-01-27T14:59:39.022193+0000","last_fullsized":"2024-01-27T14:59:39.022193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.316294+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:59:24.316294+0000","last_peered":"2024-01-27T14:59:24.316294+0000","last_clean":"2024-01-27T14:59:24.316294+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:59:24.316294+0000","last_undegraded":"2024-01-27T14:59:24.316294+0000","last_fullsized":"2024-01-27T14:59:24.316294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:31.085666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.167503+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:59:08.167503+0000","last_peered":"2024-01-27T14:59:08.167503+0000","last_clean":"2024-01-27T14:59:08.167503+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:59:08.167503+0000","last_undegraded":"2024-01-27T14:59:08.167503+0000","last_fullsized":"2024-01-27T14:59:08.167503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058740+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:59:39.058740+0000","last_peered":"2024-01-27T14:59:39.058740+0000","last_clean":"2024-01-27T14:59:39.058740+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:39.058740+0000","last_undegraded":"2024-01-27T14:59:39.058740+0000","last_fullsized":"2024-01-27T14:59:39.058740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:58:59.361308+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:58:59.361308+0000","last_peered":"2024-01-27T14:58:59.361308+0000","last_clean":"2024-01-27T14:58:59.361308+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:58:59.361308+0000","last_undegraded":"2024-01-27T14:58:59.361308+0000","last_fullsized":"2024-01-27T14:58:59.361308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.911629+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:59:09.911629+0000","last_peered":"2024-01-27T14:59:09.911629+0000","last_clean":"2024-01-27T14:59:09.911629+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:59:09.911629+0000","last_undegraded":"2024-01-27T14:59:09.911629+0000","last_fullsized":"2024-01-27T14:59:09.911629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.067394+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:59:39.067394+0000","last_peered":"2024-01-27T14:59:39.067394+0000","last_clean":"2024-01-27T14:59:39.067394+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:59:39.067394+0000","last_undegraded":"2024-01-27T14:59:39.067394+0000","last_fullsized":"2024-01-27T14:59:39.067394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'10","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.340212+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:59:25.340212+0000","last_peered":"2024-01-27T14:59:25.340212+0000","last_clean":"2024-01-27T14:59:25.340212+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:59:25.340212+0000","last_undegraded":"2024-01-27T14:59:25.340212+0000","last_fullsized":"2024-01-27T14:59:25.340212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:33.387998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.875622+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:59:10.875622+0000","last_peered":"2024-01-27T14:59:10.875622+0000","last_clean":"2024-01-27T14:59:10.875622+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:59:10.875622+0000","last_undegraded":"2024-01-27T14:59:10.875622+0000","last_fullsized":"2024-01-27T14:59:10.875622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049959+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:59:39.049959+0000","last_peered":"2024-01-27T14:59:39.049959+0000","last_clean":"2024-01-27T14:59:39.049959+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:59:39.049959+0000","last_undegraded":"2024-01-27T14:59:39.049959+0000","last_fullsized":"2024-01-27T14:59:39.049959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:17.957409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'934","reported_seq":1898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:36.353045+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:59:36.353045+0000","last_peered":"2024-01-27T14:59:36.353045+0000","last_clean":"2024-01-27T14:59:36.353045+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:36.353045+0000","last_undegraded":"2024-01-27T14:59:36.353045+0000","last_fullsized":"2024-01-27T14:59:36.353045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.790336+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:59:09.790336+0000","last_peered":"2024-01-27T14:59:09.790336+0000","last_clean":"2024-01-27T14:59:09.790336+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:59:09.790336+0000","last_undegraded":"2024-01-27T14:59:09.790336+0000","last_fullsized":"2024-01-27T14:59:09.790336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021770+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:59:39.021770+0000","last_peered":"2024-01-27T14:59:39.021770+0000","last_clean":"2024-01-27T14:59:39.021770+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:39.021770+0000","last_undegraded":"2024-01-27T14:59:39.021770+0000","last_fullsized":"2024-01-27T14:59:39.021770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'478","reported_seq":519,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.853827+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:59:15.853827+0000","last_peered":"2024-01-27T14:59:15.853827+0000","last_clean":"2024-01-27T14:59:15.853827+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:59:15.853827+0000","last_undegraded":"2024-01-27T14:59:15.853827+0000","last_fullsized":"2024-01-27T14:59:15.853827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:57.361729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":166,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.940972+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:59:10.940972+0000","last_peered":"2024-01-27T14:59:10.940972+0000","last_clean":"2024-01-27T14:59:10.940972+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:59:10.940972+0000","last_undegraded":"2024-01-27T14:59:10.940972+0000","last_fullsized":"2024-01-27T14:59:10.940972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:25.825825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.154667+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:59:39.154667+0000","last_peered":"2024-01-27T14:59:39.154667+0000","last_clean":"2024-01-27T14:59:39.154667+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:59:39.154667+0000","last_undegraded":"2024-01-27T14:59:39.154667+0000","last_fullsized":"2024-01-27T14:59:39.154667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'12","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315933+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:59:31.315933+0000","last_peered":"2024-01-27T14:59:31.315933+0000","last_clean":"2024-01-27T14:59:31.315933+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:59:31.315933+0000","last_undegraded":"2024-01-27T14:59:31.315933+0000","last_fullsized":"2024-01-27T14:59:31.315933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:27.735093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:39.292535+0000","last_change":"2024-01-27T14:31:31.263144+0000","last_active":"2024-01-27T14:57:39.292535+0000","last_peered":"2024-01-27T14:57:39.292535+0000","last_clean":"2024-01-27T14:57:39.292535+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:57:39.292535+0000","last_undegraded":"2024-01-27T14:57:39.292535+0000","last_fullsized":"2024-01-27T14:57:39.292535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:29.892867+0000","last_clean_scrub_stamp":"2024-01-27T14:31:29.892867+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:32.145961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.317475+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:59:09.317475+0000","last_peered":"2024-01-27T14:59:09.317475+0000","last_clean":"2024-01-27T14:59:09.317475+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:59:09.317475+0000","last_undegraded":"2024-01-27T14:59:09.317475+0000","last_fullsized":"2024-01-27T14:59:09.317475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:39:09.594534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.036199+0000","last_change":"2024-01-27T14:31:51.993052+0000","last_active":"2024-01-27T14:59:39.036199+0000","last_peered":"2024-01-27T14:59:39.036199+0000","last_clean":"2024-01-27T14:59:39.036199+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:39.036199+0000","last_undegraded":"2024-01-27T14:59:39.036199+0000","last_fullsized":"2024-01-27T14:59:39.036199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:13.021734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.360055+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:59:32.360055+0000","last_peered":"2024-01-27T14:59:32.360055+0000","last_clean":"2024-01-27T14:59:32.360055+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:32.360055+0000","last_undegraded":"2024-01-27T14:59:32.360055+0000","last_fullsized":"2024-01-27T14:59:32.360055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.786852+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:59:10.786852+0000","last_peered":"2024-01-27T14:59:10.786852+0000","last_clean":"2024-01-27T14:59:10.786852+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:59:10.786852+0000","last_undegraded":"2024-01-27T14:59:10.786852+0000","last_fullsized":"2024-01-27T14:59:10.786852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:26.078953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124898+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:59:39.124898+0000","last_peered":"2024-01-27T14:59:39.124898+0000","last_clean":"2024-01-27T14:59:39.124898+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:59:39.124898+0000","last_undegraded":"2024-01-27T14:59:39.124898+0000","last_fullsized":"2024-01-27T14:59:39.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.320392+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:59:24.320392+0000","last_peered":"2024-01-27T14:59:24.320392+0000","last_clean":"2024-01-27T14:59:24.320392+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:24.320392+0000","last_undegraded":"2024-01-27T14:59:24.320392+0000","last_fullsized":"2024-01-27T14:59:24.320392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:10.839184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":213,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.599426+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:59:08.599426+0000","last_peered":"2024-01-27T14:59:08.599426+0000","last_clean":"2024-01-27T14:59:08.599426+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:59:08.599426+0000","last_undegraded":"2024-01-27T14:59:08.599426+0000","last_fullsized":"2024-01-27T14:59:08.599426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145584+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:59:39.145584+0000","last_peered":"2024-01-27T14:59:39.145584+0000","last_clean":"2024-01-27T14:59:39.145584+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:59:39.145584+0000","last_undegraded":"2024-01-27T14:59:39.145584+0000","last_fullsized":"2024-01-27T14:59:39.145584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:22.083460+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:59:22.083460+0000","last_peered":"2024-01-27T14:59:22.083460+0000","last_clean":"2024-01-27T14:59:22.083460+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:22.083460+0000","last_undegraded":"2024-01-27T14:59:22.083460+0000","last_fullsized":"2024-01-27T14:59:22.083460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:55:57.193225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.647605+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:59:08.647605+0000","last_peered":"2024-01-27T14:59:08.647605+0000","last_clean":"2024-01-27T14:59:08.647605+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:59:08.647605+0000","last_undegraded":"2024-01-27T14:59:08.647605+0000","last_fullsized":"2024-01-27T14:59:08.647605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:08.540586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051278+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:59:39.051278+0000","last_peered":"2024-01-27T14:59:39.051278+0000","last_clean":"2024-01-27T14:59:39.051278+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:39.051278+0000","last_undegraded":"2024-01-27T14:59:39.051278+0000","last_fullsized":"2024-01-27T14:59:39.051278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:00:32.212304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:15.843679+0000","last_change":"2024-01-27T14:31:50.746377+0000","last_active":"2024-01-27T14:59:15.843679+0000","last_peered":"2024-01-27T14:59:15.843679+0000","last_clean":"2024-01-27T14:59:15.843679+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:15.843679+0000","last_undegraded":"2024-01-27T14:59:15.843679+0000","last_fullsized":"2024-01-27T14:59:15.843679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.364571+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:59:08.364571+0000","last_peered":"2024-01-27T14:59:08.364571+0000","last_clean":"2024-01-27T14:59:08.364571+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:08.364571+0000","last_undegraded":"2024-01-27T14:59:08.364571+0000","last_fullsized":"2024-01-27T14:59:08.364571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:07:34.730182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027341+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:59:39.027341+0000","last_peered":"2024-01-27T14:59:39.027341+0000","last_clean":"2024-01-27T14:59:39.027341+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:39.027341+0000","last_undegraded":"2024-01-27T14:59:39.027341+0000","last_fullsized":"2024-01-27T14:59:39.027341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:50.248953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.047429+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:59:20.047429+0000","last_peered":"2024-01-27T14:59:20.047429+0000","last_clean":"2024-01-27T14:59:20.047429+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:20.047429+0000","last_undegraded":"2024-01-27T14:59:20.047429+0000","last_fullsized":"2024-01-27T14:59:20.047429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826757+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:59:10.826757+0000","last_peered":"2024-01-27T14:59:10.826757+0000","last_clean":"2024-01-27T14:59:10.826757+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:59:10.826757+0000","last_undegraded":"2024-01-27T14:59:10.826757+0000","last_fullsized":"2024-01-27T14:59:10.826757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:53:03.076065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049463+0000","last_change":"2024-01-27T14:31:51.992777+0000","last_active":"2024-01-27T14:59:39.049463+0000","last_peered":"2024-01-27T14:59:39.049463+0000","last_clean":"2024-01-27T14:59:39.049463+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:39.049463+0000","last_undegraded":"2024-01-27T14:59:39.049463+0000","last_fullsized":"2024-01-27T14:59:39.049463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:21.028639+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:59:21.028639+0000","last_peered":"2024-01-27T14:59:21.028639+0000","last_clean":"2024-01-27T14:59:21.028639+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:21.028639+0000","last_undegraded":"2024-01-27T14:59:21.028639+0000","last_fullsized":"2024-01-27T14:59:21.028639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:37.974573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":148,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.801323+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:59:10.801323+0000","last_peered":"2024-01-27T14:59:10.801323+0000","last_clean":"2024-01-27T14:59:10.801323+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:59:10.801323+0000","last_undegraded":"2024-01-27T14:59:10.801323+0000","last_fullsized":"2024-01-27T14:59:10.801323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:17.604720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.038975+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:59:39.038975+0000","last_peered":"2024-01-27T14:59:39.038975+0000","last_clean":"2024-01-27T14:59:39.038975+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:59:39.038975+0000","last_undegraded":"2024-01-27T14:59:39.038975+0000","last_fullsized":"2024-01-27T14:59:39.038975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:24.509686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'13","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.315964+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:59:31.315964+0000","last_peered":"2024-01-27T14:59:31.315964+0000","last_clean":"2024-01-27T14:59:31.315964+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:59:31.315964+0000","last_undegraded":"2024-01-27T14:59:31.315964+0000","last_fullsized":"2024-01-27T14:59:31.315964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.246924+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:59:08.246924+0000","last_peered":"2024-01-27T14:59:08.246924+0000","last_clean":"2024-01-27T14:59:08.246924+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:59:08.246924+0000","last_undegraded":"2024-01-27T14:59:08.246924+0000","last_fullsized":"2024-01-27T14:59:08.246924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020881+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:59:39.020881+0000","last_peered":"2024-01-27T14:59:39.020881+0000","last_clean":"2024-01-27T14:59:39.020881+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.020881+0000","last_undegraded":"2024-01-27T14:59:39.020881+0000","last_fullsized":"2024-01-27T14:59:39.020881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'260","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.313960+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:59:39.313960+0000","last_peered":"2024-01-27T14:59:39.313960+0000","last_clean":"2024-01-27T14:59:39.313960+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:39.313960+0000","last_undegraded":"2024-01-27T14:59:39.313960+0000","last_fullsized":"2024-01-27T14:59:39.313960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:07.923827+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:59:07.923827+0000","last_peered":"2024-01-27T14:59:07.923827+0000","last_clean":"2024-01-27T14:59:07.923827+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:59:07.923827+0000","last_undegraded":"2024-01-27T14:59:07.923827+0000","last_fullsized":"2024-01-27T14:59:07.923827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:55:18.890184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124883+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:59:39.124883+0000","last_peered":"2024-01-27T14:59:39.124883+0000","last_clean":"2024-01-27T14:59:39.124883+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:59:39.124883+0000","last_undegraded":"2024-01-27T14:59:39.124883+0000","last_fullsized":"2024-01-27T14:59:39.124883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'829","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:24.293124+0000","last_change":"2024-01-27T14:31:50.744620+0000","last_active":"2024-01-27T14:59:24.293124+0000","last_peered":"2024-01-27T14:59:24.293124+0000","last_clean":"2024-01-27T14:59:24.293124+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:24.293124+0000","last_undegraded":"2024-01-27T14:59:24.293124+0000","last_fullsized":"2024-01-27T14:59:24.293124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:25:38.134368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.826629+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:59:09.826629+0000","last_peered":"2024-01-27T14:59:09.826629+0000","last_clean":"2024-01-27T14:59:09.826629+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:59:09.826629+0000","last_undegraded":"2024-01-27T14:59:09.826629+0000","last_fullsized":"2024-01-27T14:59:09.826629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.040394+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:59:39.040394+0000","last_peered":"2024-01-27T14:59:39.040394+0000","last_clean":"2024-01-27T14:59:39.040394+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:39.040394+0000","last_undegraded":"2024-01-27T14:59:39.040394+0000","last_fullsized":"2024-01-27T14:59:39.040394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'629","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.377338+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:59:32.377338+0000","last_peered":"2024-01-27T14:59:32.377338+0000","last_clean":"2024-01-27T14:59:32.377338+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:32.377338+0000","last_undegraded":"2024-01-27T14:59:32.377338+0000","last_fullsized":"2024-01-27T14:59:32.377338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.914090+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:59:09.914090+0000","last_peered":"2024-01-27T14:59:09.914090+0000","last_clean":"2024-01-27T14:59:09.914090+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:59:09.914090+0000","last_undegraded":"2024-01-27T14:59:09.914090+0000","last_fullsized":"2024-01-27T14:59:09.914090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:41:56.117404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.052297+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:59:39.052297+0000","last_peered":"2024-01-27T14:59:39.052297+0000","last_clean":"2024-01-27T14:59:39.052297+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:59:39.052297+0000","last_undegraded":"2024-01-27T14:59:39.052297+0000","last_fullsized":"2024-01-27T14:59:39.052297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:31.311314+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:59:31.311314+0000","last_peered":"2024-01-27T14:59:31.311314+0000","last_clean":"2024-01-27T14:59:31.311314+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:31.311314+0000","last_undegraded":"2024-01-27T14:59:31.311314+0000","last_fullsized":"2024-01-27T14:59:31.311314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:22.166488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.360645+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:59:08.360645+0000","last_peered":"2024-01-27T14:59:08.360645+0000","last_clean":"2024-01-27T14:59:08.360645+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:59:08.360645+0000","last_undegraded":"2024-01-27T14:59:08.360645+0000","last_fullsized":"2024-01-27T14:59:08.360645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065121+0000","last_change":"2024-01-27T14:31:51.995356+0000","last_active":"2024-01-27T14:59:39.065121+0000","last_peered":"2024-01-27T14:59:39.065121+0000","last_clean":"2024-01-27T14:59:39.065121+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:39.065121+0000","last_undegraded":"2024-01-27T14:59:39.065121+0000","last_fullsized":"2024-01-27T14:59:39.065121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:57:34.514636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'17","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:38.839260+0000","last_change":"2024-01-27T14:31:50.731005+0000","last_active":"2024-01-27T14:59:38.839260+0000","last_peered":"2024-01-27T14:59:38.839260+0000","last_clean":"2024-01-27T14:59:38.839260+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:38.839260+0000","last_undegraded":"2024-01-27T14:59:38.839260+0000","last_fullsized":"2024-01-27T14:59:38.839260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:44:25.266133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.861248+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:59:10.861248+0000","last_peered":"2024-01-27T14:59:10.861248+0000","last_clean":"2024-01-27T14:59:10.861248+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:59:10.861248+0000","last_undegraded":"2024-01-27T14:59:10.861248+0000","last_fullsized":"2024-01-27T14:59:10.861248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989182+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:59:10.989182+0000","last_peered":"2024-01-27T14:59:10.989182+0000","last_clean":"2024-01-27T14:59:10.989182+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:59:10.989182+0000","last_undegraded":"2024-01-27T14:59:10.989182+0000","last_fullsized":"2024-01-27T14:59:10.989182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:01.713938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.159992+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:59:39.159992+0000","last_peered":"2024-01-27T14:59:39.159992+0000","last_clean":"2024-01-27T14:59:39.159992+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:39.159992+0000","last_undegraded":"2024-01-27T14:59:39.159992+0000","last_fullsized":"2024-01-27T14:59:39.159992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:18:02.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:17.861159+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:59:17.861159+0000","last_peered":"2024-01-27T14:59:17.861159+0000","last_clean":"2024-01-27T14:59:17.861159+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:59:17.861159+0000","last_undegraded":"2024-01-27T14:59:17.861159+0000","last_fullsized":"2024-01-27T14:59:17.861159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:42.822271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.930556+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:59:09.930556+0000","last_peered":"2024-01-27T14:59:09.930556+0000","last_clean":"2024-01-27T14:59:09.930556+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:59:09.930556+0000","last_undegraded":"2024-01-27T14:59:09.930556+0000","last_fullsized":"2024-01-27T14:59:09.930556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:40:49.739071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048755+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:59:39.048755+0000","last_peered":"2024-01-27T14:59:39.048755+0000","last_clean":"2024-01-27T14:59:39.048755+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:59:39.048755+0000","last_undegraded":"2024-01-27T14:59:39.048755+0000","last_fullsized":"2024-01-27T14:59:39.048755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.046360+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:59:20.046360+0000","last_peered":"2024-01-27T14:59:20.046360+0000","last_clean":"2024-01-27T14:59:20.046360+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:20.046360+0000","last_undegraded":"2024-01-27T14:59:20.046360+0000","last_fullsized":"2024-01-27T14:59:20.046360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'660","reported_seq":699,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:30.373035+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:59:30.373035+0000","last_peered":"2024-01-27T14:59:30.373035+0000","last_clean":"2024-01-27T14:59:30.373035+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:59:30.373035+0000","last_undegraded":"2024-01-27T14:59:30.373035+0000","last_fullsized":"2024-01-27T14:59:30.373035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:55.053858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157899+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:59:39.157899+0000","last_peered":"2024-01-27T14:59:39.157899+0000","last_clean":"2024-01-27T14:59:39.157899+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:59:39.157899+0000","last_undegraded":"2024-01-27T14:59:39.157899+0000","last_fullsized":"2024-01-27T14:59:39.157899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:09:28.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989218+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:59:10.989218+0000","last_peered":"2024-01-27T14:59:10.989218+0000","last_clean":"2024-01-27T14:59:10.989218+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:59:10.989218+0000","last_undegraded":"2024-01-27T14:59:10.989218+0000","last_fullsized":"2024-01-27T14:59:10.989218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:10.468807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.362004+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:59:29.362004+0000","last_peered":"2024-01-27T14:59:29.362004+0000","last_clean":"2024-01-27T14:59:29.362004+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:29.362004+0000","last_undegraded":"2024-01-27T14:59:29.362004+0000","last_fullsized":"2024-01-27T14:59:29.362004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.057195+0000","last_change":"2024-01-27T14:31:51.994429+0000","last_active":"2024-01-27T14:59:39.057195+0000","last_peered":"2024-01-27T14:59:39.057195+0000","last_clean":"2024-01-27T14:59:39.057195+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:39.057195+0000","last_undegraded":"2024-01-27T14:59:39.057195+0000","last_fullsized":"2024-01-27T14:59:39.057195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.799454+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:59:10.799454+0000","last_peered":"2024-01-27T14:59:10.799454+0000","last_clean":"2024-01-27T14:59:10.799454+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:59:10.799454+0000","last_undegraded":"2024-01-27T14:59:10.799454+0000","last_fullsized":"2024-01-27T14:59:10.799454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.062850+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:59:39.062850+0000","last_peered":"2024-01-27T14:59:39.062850+0000","last_clean":"2024-01-27T14:59:39.062850+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:39.062850+0000","last_undegraded":"2024-01-27T14:59:39.062850+0000","last_fullsized":"2024-01-27T14:59:39.062850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.045705+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:59:39.045705+0000","last_peered":"2024-01-27T14:59:39.045705+0000","last_clean":"2024-01-27T14:59:39.045705+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:39.045705+0000","last_undegraded":"2024-01-27T14:59:39.045705+0000","last_fullsized":"2024-01-27T14:59:39.045705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022545+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:59:39.022545+0000","last_peered":"2024-01-27T14:59:39.022545+0000","last_clean":"2024-01-27T14:59:39.022545+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:39.022545+0000","last_undegraded":"2024-01-27T14:59:39.022545+0000","last_fullsized":"2024-01-27T14:59:39.022545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:42:11.736269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.051601+0000","last_change":"2024-01-27T14:31:52.005314+0000","last_active":"2024-01-27T14:59:39.051601+0000","last_peered":"2024-01-27T14:59:39.051601+0000","last_clean":"2024-01-27T14:59:39.051601+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:39.051601+0000","last_undegraded":"2024-01-27T14:59:39.051601+0000","last_fullsized":"2024-01-27T14:59:39.051601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:30:13.723969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021084+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:59:39.021084+0000","last_peered":"2024-01-27T14:59:39.021084+0000","last_clean":"2024-01-27T14:59:39.021084+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:59:39.021084+0000","last_undegraded":"2024-01-27T14:59:39.021084+0000","last_fullsized":"2024-01-27T14:59:39.021084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.019956+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:59:39.019956+0000","last_peered":"2024-01-27T14:59:39.019956+0000","last_clean":"2024-01-27T14:59:39.019956+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:59:39.019956+0000","last_undegraded":"2024-01-27T14:59:39.019956+0000","last_fullsized":"2024-01-27T14:59:39.019956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.061185+0000","last_change":"2024-01-27T14:31:51.995391+0000","last_active":"2024-01-27T14:59:39.061185+0000","last_peered":"2024-01-27T14:59:39.061185+0000","last_clean":"2024-01-27T14:59:39.061185+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:39.061185+0000","last_undegraded":"2024-01-27T14:59:39.061185+0000","last_fullsized":"2024-01-27T14:59:39.061185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:58.488367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.047267+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:59:39.047267+0000","last_peered":"2024-01-27T14:59:39.047267+0000","last_clean":"2024-01-27T14:59:39.047267+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:59:39.047267+0000","last_undegraded":"2024-01-27T14:59:39.047267+0000","last_fullsized":"2024-01-27T14:59:39.047267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.030949+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:59:39.030949+0000","last_peered":"2024-01-27T14:59:39.030949+0000","last_clean":"2024-01-27T14:59:39.030949+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:39.030949+0000","last_undegraded":"2024-01-27T14:59:39.030949+0000","last_fullsized":"2024-01-27T14:59:39.030949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050100+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:59:39.050100+0000","last_peered":"2024-01-27T14:59:39.050100+0000","last_clean":"2024-01-27T14:59:39.050100+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:59:39.050100+0000","last_undegraded":"2024-01-27T14:59:39.050100+0000","last_fullsized":"2024-01-27T14:59:39.050100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058983+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:59:39.058983+0000","last_peered":"2024-01-27T14:59:39.058983+0000","last_clean":"2024-01-27T14:59:39.058983+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.058983+0000","last_undegraded":"2024-01-27T14:59:39.058983+0000","last_fullsized":"2024-01-27T14:59:39.058983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157835+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:59:39.157835+0000","last_peered":"2024-01-27T14:59:39.157835+0000","last_clean":"2024-01-27T14:59:39.157835+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:39.157835+0000","last_undegraded":"2024-01-27T14:59:39.157835+0000","last_fullsized":"2024-01-27T14:59:39.157835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:05:22.115357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.145636+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:59:39.145636+0000","last_peered":"2024-01-27T14:59:39.145636+0000","last_clean":"2024-01-27T14:59:39.145636+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:59:39.145636+0000","last_undegraded":"2024-01-27T14:59:39.145636+0000","last_fullsized":"2024-01-27T14:59:39.145636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.023696+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:59:39.023696+0000","last_peered":"2024-01-27T14:59:39.023696+0000","last_clean":"2024-01-27T14:59:39.023696+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:59:39.023696+0000","last_undegraded":"2024-01-27T14:59:39.023696+0000","last_fullsized":"2024-01-27T14:59:39.023696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:52:57.207614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048100+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:59:39.048100+0000","last_peered":"2024-01-27T14:59:39.048100+0000","last_clean":"2024-01-27T14:59:39.048100+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:59:39.048100+0000","last_undegraded":"2024-01-27T14:59:39.048100+0000","last_fullsized":"2024-01-27T14:59:39.048100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.027716+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:59:39.027716+0000","last_peered":"2024-01-27T14:59:39.027716+0000","last_clean":"2024-01-27T14:59:39.027716+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:59:39.027716+0000","last_undegraded":"2024-01-27T14:59:39.027716+0000","last_fullsized":"2024-01-27T14:59:39.027716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:41:19.957374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.028460+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:59:39.028460+0000","last_peered":"2024-01-27T14:59:39.028460+0000","last_clean":"2024-01-27T14:59:39.028460+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:39.028460+0000","last_undegraded":"2024-01-27T14:59:39.028460+0000","last_fullsized":"2024-01-27T14:59:39.028460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:08:38.706405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046375+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:59:39.046375+0000","last_peered":"2024-01-27T14:59:39.046375+0000","last_clean":"2024-01-27T14:59:39.046375+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:39.046375+0000","last_undegraded":"2024-01-27T14:59:39.046375+0000","last_fullsized":"2024-01-27T14:59:39.046375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:49.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020810+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:59:39.020810+0000","last_peered":"2024-01-27T14:59:39.020810+0000","last_clean":"2024-01-27T14:59:39.020810+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:59:39.020810+0000","last_undegraded":"2024-01-27T14:59:39.020810+0000","last_fullsized":"2024-01-27T14:59:39.020810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020831+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:59:39.020831+0000","last_peered":"2024-01-27T14:59:39.020831+0000","last_clean":"2024-01-27T14:59:39.020831+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:39.020831+0000","last_undegraded":"2024-01-27T14:59:39.020831+0000","last_fullsized":"2024-01-27T14:59:39.020831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.146288+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:59:39.146288+0000","last_peered":"2024-01-27T14:59:39.146288+0000","last_clean":"2024-01-27T14:59:39.146288+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:39.146288+0000","last_undegraded":"2024-01-27T14:59:39.146288+0000","last_fullsized":"2024-01-27T14:59:39.146288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:46:39.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129537+0000","last_change":"2024-01-27T14:31:52.006298+0000","last_active":"2024-01-27T14:59:39.129537+0000","last_peered":"2024-01-27T14:59:39.129537+0000","last_clean":"2024-01-27T14:59:39.129537+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:39.129537+0000","last_undegraded":"2024-01-27T14:59:39.129537+0000","last_fullsized":"2024-01-27T14:59:39.129537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:20.210503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148552+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:59:39.148552+0000","last_peered":"2024-01-27T14:59:39.148552+0000","last_clean":"2024-01-27T14:59:39.148552+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:39.148552+0000","last_undegraded":"2024-01-27T14:59:39.148552+0000","last_fullsized":"2024-01-27T14:59:39.148552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:14.510013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058014+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:59:39.058014+0000","last_peered":"2024-01-27T14:59:39.058014+0000","last_clean":"2024-01-27T14:59:39.058014+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:39.058014+0000","last_undegraded":"2024-01-27T14:59:39.058014+0000","last_fullsized":"2024-01-27T14:59:39.058014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050038+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:59:39.050038+0000","last_peered":"2024-01-27T14:59:39.050038+0000","last_clean":"2024-01-27T14:59:39.050038+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:59:39.050038+0000","last_undegraded":"2024-01-27T14:59:39.050038+0000","last_fullsized":"2024-01-27T14:59:39.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:31.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065671+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:59:39.065671+0000","last_peered":"2024-01-27T14:59:39.065671+0000","last_clean":"2024-01-27T14:59:39.065671+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:59:39.065671+0000","last_undegraded":"2024-01-27T14:59:39.065671+0000","last_fullsized":"2024-01-27T14:59:39.065671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:37:27.815344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.055089+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:59:39.055089+0000","last_peered":"2024-01-27T14:59:39.055089+0000","last_clean":"2024-01-27T14:59:39.055089+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:39.055089+0000","last_undegraded":"2024-01-27T14:59:39.055089+0000","last_fullsized":"2024-01-27T14:59:39.055089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050346+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:59:39.050346+0000","last_peered":"2024-01-27T14:59:39.050346+0000","last_clean":"2024-01-27T14:59:39.050346+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:59:39.050346+0000","last_undegraded":"2024-01-27T14:59:39.050346+0000","last_fullsized":"2024-01-27T14:59:39.050346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065975+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:59:39.065975+0000","last_peered":"2024-01-27T14:59:39.065975+0000","last_clean":"2024-01-27T14:59:39.065975+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:39.065975+0000","last_undegraded":"2024-01-27T14:59:39.065975+0000","last_fullsized":"2024-01-27T14:59:39.065975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:23.293126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048739+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:59:39.048739+0000","last_peered":"2024-01-27T14:59:39.048739+0000","last_clean":"2024-01-27T14:59:39.048739+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:39.048739+0000","last_undegraded":"2024-01-27T14:59:39.048739+0000","last_fullsized":"2024-01-27T14:59:39.048739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.037581+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:59:39.037581+0000","last_peered":"2024-01-27T14:59:39.037581+0000","last_clean":"2024-01-27T14:59:39.037581+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:59:39.037581+0000","last_undegraded":"2024-01-27T14:59:39.037581+0000","last_fullsized":"2024-01-27T14:59:39.037581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:54:53.989774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.111454+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:59:39.111454+0000","last_peered":"2024-01-27T14:59:39.111454+0000","last_clean":"2024-01-27T14:59:39.111454+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:39.111454+0000","last_undegraded":"2024-01-27T14:59:39.111454+0000","last_fullsized":"2024-01-27T14:59:39.111454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:48:42.661596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509783,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.58399999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.41699999999999998},"min":{"1min":0.32100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65200000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.434},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.80100000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60799999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.442,"15min":0.441},"min":{"1min":0.33000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.54000000000000004,"5min":0.64200000000000002,"15min":0.66100000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.44600000000000001,"5min":0.60499999999999998,"15min":0.76900000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.55800000000000005,"15min":0.621},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.46600000000000003,"5min":0.54000000000000004,"15min":0.59899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509783,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.58199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.67100000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.64000000000000001},"last":0.62},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66500000000000004},"last":0.63}]},{"osd":3,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.65500000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61899999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.44},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.71999999999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.58599999999999997},"last":0.38800000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.441,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46899999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.19,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.495,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.312},"min":{"1min":0.20899999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.437,"5min":0.47099999999999997,"15min":0.57499999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.373,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52500000000000002,"15min":0.68200000000000005},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.53700000000000003,"15min":0.64800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.378},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.72499999999999998},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.432,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.71599999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.71899999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.66200000000000003,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.753},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.41599999999999998,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.78000000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.39100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66400000000000003,"5min":0.67600000000000005,"15min":0.79500000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.75600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.502,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.59399999999999997,"5min":0.73199999999999998,"15min":0.76000000000000001},"last":0.65200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.28599999999999998,"15min":0.28999999999999998},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.375,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":0.58499999999999996,"15min":0.59699999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27300000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.42699999999999999,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.313},"max":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.442,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.65700000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54800000000000004,"5min":0.752,"15min":0.752},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.51800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.191},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.502}]},{"osd":3,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.62},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.248},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.747},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.28999999999999998},"max":{"1min":0.628,"5min":0.872,"15min":0.872},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509782,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":0.45700000000000002,"5min":0.47699999999999998,"15min":0.53700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.315},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.55000000000000004,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.61399999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.192,"15min":0.192},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.224},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.80700000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.63800000000000001,"15min":0.79500000000000004},"last":0.499}]},{"osd":5,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.68600000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.497,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.70599999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.61599999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.23699999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.313,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.68700000000000006},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.51800000000000002,"5min":0.64800000000000002,"15min":0.66100000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59899999999999998,"5min":0.63800000000000001,"15min":0.68899999999999995},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.63300000000000001,"15min":0.63800000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.67400000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Jan 27 14:59:10 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.621},"last":0.501},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51700000000000002,"5min":0.59799999999999998,"15min":0.625},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.58199999999999996,"15min":0.65600000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.628}]}]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.501}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:59:47.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:59:47.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.230+0000 7f6fc5d1d640 1 Processor -- start 2024-01-27T14:59:47.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.230+0000 7f6fc5d1d640 1 -- start start 2024-01-27T14:59:47.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.231+0000 7f6fc5d1d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6fc006fb80 0x7f6fc015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:47.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.231+0000 7f6fc5d1d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc006efe0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.231+0000 7f6fc5d1d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc0066ad0 con 0x7f6fc00c5250 2024-01-27T14:59:47.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.231+0000 7f6fc5d1d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00667f0 con 0x7f6fc006fb80 2024-01-27T14:59:47.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.232+0000 7f6fbffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6fc006fb80 0x7f6fc015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:47.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.232+0000 7f6fbeffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6fc00c5250 0x7f6fc006f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:35308/0 (socket says 172.21.15.46:35308) 2024-01-27T14:59:47.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.232+0000 7f6fbeffd640 1 -- 172.21.15.46:0/1665269447 learned_addr learned my addr 172.21.15.46:0/1665269447 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.235+0000 7f6fbe7fc640 1 -- 172.21.15.46:0/1665269447 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920356402 0 0) 0x7f6fc0066ad0 con 0x7f6fc00c5250 2024-01-27T14:59:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.235+0000 7f6fbe7fc640 1 -- 172.21.15.46:0/1665269447 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa8003520 con 0x7f6fc00c5250 2024-01-27T14:59:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.235+0000 7f6fbffff640 1 -- 172.21.15.46:0/1665269447 >> v1:172.21.15.73:6789/0 conn(0x7f6fc00c5250 legacy=0x7f6fc006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.235+0000 7f6fbffff640 1 -- 172.21.15.46:0/1665269447 >> v1:172.21.15.46:6789/0 conn(0x7f6fc00c4e70 legacy=0x7f6fc006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:47.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.235+0000 7f6fbffff640 1 -- 172.21.15.46:0/1665269447 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc006a760 con 0x7f6fc006fb80 2024-01-27T14:59:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.238+0000 7f6fbffff640 1 --2- 172.21.15.46:0/1665269447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc006fb80 0x7f6fc015b4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009d90 tx=0x7f6fb802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f5a211e8f37e3d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fbe7fc640 1 -- 172.21.15.46:0/1665269447 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb802cd00 con 0x7f6fc006fb80 2024-01-27T14:59:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fbe7fc640 1 -- 172.21.15.46:0/1665269447 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb802ce60 con 0x7f6fc006fb80 2024-01-27T14:59:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fbe7fc640 1 -- 172.21.15.46:0/1665269447 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8034660 con 0x7f6fc006fb80 2024-01-27T14:59:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1665269447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc006fb80 msgr2=0x7f6fc015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1665269447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc006fb80 0x7f6fc015b4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009d90 tx=0x7f6fb802bf50 comp rx=0 tx=0).stop 2024-01-27T14:59:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1665269447 shutdown_connections 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1665269447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc006fb80 0x7f6fc015b4c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1665269447 >> 172.21.15.46:0/1665269447 conn(0x7f6fc00c7ff0 msgr2=0x7f6fc00c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1665269447 shutdown_connections 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.247+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1665269447 wait complete. 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.249+0000 7f6fc5d1d640 1 Processor -- start 2024-01-27T14:59:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.249+0000 7f6fc5d1d640 1 -- start start 2024-01-27T14:59:47.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.249+0000 7f6fc5d1d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6fc006fb80 0x7f6fc01ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:47.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.249+0000 7f6fc5d1d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.249+0000 7f6fc5d1d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc00c5250 0x7f6fc01eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fc5d1d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc01e0bd0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fc5d1d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0148220 con 0x7f6fc00c5250 2024-01-27T14:59:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fc5d1d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc01f1830 con 0x7f6fc006fb80 2024-01-27T14:59:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fbeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fbeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33754/0 (socket says 172.21.15.46:33754) 2024-01-27T14:59:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fbeffd640 1 -- 172.21.15.46:0/1043519408 learned_addr learned my addr 172.21.15.46:0/1043519408 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fbffff640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc00c5250 0x7f6fc01eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.250+0000 7f6fbf7fe640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6fc006fb80 0x7f6fc01ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:47.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.254+0000 7f6fbeffd640 1 -- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6fc006fb80 msgr2=0x7f6fc01ee300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.254+0000 7f6fbeffd640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6fc006fb80 0x7f6fc01ee300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.254+0000 7f6fbeffd640 1 -- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc00c5250 msgr2=0x7f6fc01eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.254+0000 7f6fbeffd640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc00c5250 0x7f6fc01eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.254+0000 7f6fbeffd640 1 -- 172.21.15.46:0/1043519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8009a70 con 0x7f6fc00c4e70 2024-01-27T14:59:47.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.256+0000 7f6fbeffd640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c390 tx=0x7f6fb000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:47.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.260+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0005ce0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.260+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0005e40 con 0x7f6fc00c4e70 2024-01-27T14:59:47.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.260+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00072f0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.260+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc01f1ad0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.260+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc01edb00 con 0x7f6fc00c4e70 2024-01-27T14:59:47.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.261+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc006edd0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.530+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6fb0007450 con 0x7f6fc00c4e70 2024-01-27T14:59:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.531+0000 7f6fa7fff640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 0x7f6fac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.531+0000 7f6fbf7fe640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 0x7f6fac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.531+0000 7f6fbf7fe640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 0x7f6fac06d410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004f60 tx=0x7f6fb4007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.546+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6fb0057bd0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.546+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6fb0053f10 con 0x7f6fc00c4e70 2024-01-27T14:59:47.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.728+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc00742e0 con 0x7f6fc00c4e70 2024-01-27T14:59:47.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.770+0000 7f6fa7fff640 1 -- 172.21.15.46:0/1043519408 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f6fb0017020 con 0x7f6fc00c4e70 2024-01-27T14:59:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:47.773 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 msgr2=0x7f6fac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 0x7f6fac06d410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004f60 tx=0x7f6fb4007e30 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 msgr2=0x7f6fc01e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c390 tx=0x7f6fb000c850 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 shutdown_connections 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6fac06af50 0x7f6fac06d410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6fc00c5250 0x7f6fc01eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fc00c4e70 0x7f6fc01e40c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 --2- 172.21.15.46:0/1043519408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6fc006fb80 0x7f6fc01ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 >> 172.21.15.46:0/1043519408 conn(0x7f6fc00c7ff0 msgr2=0x7f6fc00c5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:47.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 shutdown_connections 2024-01-27T14:59:47.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:47.773+0000 7f6fc5d1d640 1 -- 172.21.15.46:0/1043519408 wait complete. 2024-01-27T14:59:48.787 INFO:tasks.ceph:Scrubbing osd.0 2024-01-27T14:59:48.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.894+0000 7f6a39756640 1 Processor -- start 2024-01-27T14:59:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.894+0000 7f6a39756640 1 -- start start 2024-01-27T14:59:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.895+0000 7f6a39756640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6a341507e0 0x7f6a34157030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.895+0000 7f6a39756640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a34156590 con 0x7f6a34071190 2024-01-27T14:59:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.895+0000 7f6a39756640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a34150bc0 con 0x7f6a34072450 2024-01-27T14:59:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.895+0000 7f6a39756640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340c19f0 con 0x7f6a341507e0 2024-01-27T14:59:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.896+0000 7f6a327fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6a34072450 0x7f6a341599f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:35320/0 (socket says 172.21.15.46:35320) 2024-01-27T14:59:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.896+0000 7f6a327fc640 1 -- 172.21.15.46:0/45284535 learned_addr learned my addr 172.21.15.46:0/45284535 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:48.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.896+0000 7f6a32ffd640 1 --2- 172.21.15.46:0/45284535 >> v2:172.21.15.46:3300/0 conn(0x7f6a341507e0 0x7f6a34157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.898+0000 7f6a31ffb640 1 -- 172.21.15.46:0/45284535 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802440256 0 0) 0x7f6a34150bc0 con 0x7f6a34072450 2024-01-27T14:59:48.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.898+0000 7f6a31ffb640 1 -- 172.21.15.46:0/45284535 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c003520 con 0x7f6a34072450 2024-01-27T14:59:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.901+0000 7f6a32ffd640 1 -- 172.21.15.46:0/45284535 >> v1:172.21.15.73:6789/0 conn(0x7f6a34072450 legacy=0x7f6a341599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.901+0000 7f6a32ffd640 1 -- 172.21.15.46:0/45284535 >> v1:172.21.15.46:6789/0 conn(0x7f6a34071190 legacy=0x7f6a3406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.901+0000 7f6a32ffd640 1 -- 172.21.15.46:0/45284535 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3415a2a0 con 0x7f6a341507e0 2024-01-27T14:59:48.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.904+0000 7f6a32ffd640 1 --2- 172.21.15.46:0/45284535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a341507e0 0x7f6a34157030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097a0 tx=0x7f6a2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c98ca27d3a2158 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:48.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a31ffb640 1 -- 172.21.15.46:0/45284535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c030610 con 0x7f6a341507e0 2024-01-27T14:59:48.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a31ffb640 1 -- 172.21.15.46:0/45284535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c030770 con 0x7f6a341507e0 2024-01-27T14:59:48.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a31ffb640 1 -- 172.21.15.46:0/45284535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c030b00 con 0x7f6a341507e0 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a39756640 1 -- 172.21.15.46:0/45284535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a341507e0 msgr2=0x7f6a34157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a39756640 1 --2- 172.21.15.46:0/45284535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a341507e0 0x7f6a34157030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097a0 tx=0x7f6a2c02b960 comp rx=0 tx=0).stop 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.910+0000 7f6a39756640 1 -- 172.21.15.46:0/45284535 shutdown_connections 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.911+0000 7f6a39756640 1 --2- 172.21.15.46:0/45284535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a341507e0 0x7f6a34157030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.911+0000 7f6a39756640 1 -- 172.21.15.46:0/45284535 >> 172.21.15.46:0/45284535 conn(0x7f6a340c7a00 msgr2=0x7f6a340c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.911+0000 7f6a39756640 1 -- 172.21.15.46:0/45284535 shutdown_connections 2024-01-27T14:59:48.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.911+0000 7f6a39756640 1 -- 172.21.15.46:0/45284535 wait complete. 2024-01-27T14:59:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.912+0000 7f6a39756640 1 Processor -- start 2024-01-27T14:59:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.912+0000 7f6a39756640 1 -- start start 2024-01-27T14:59:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a34071190 0x7f6a341ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 0x7f6a340c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a341507e0 0x7f6a34159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34156370 con 0x7f6a34071190 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341ee020 con 0x7f6a34072450 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a39756640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34158ce0 con 0x7f6a341507e0 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a337fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a341507e0 0x7f6a34159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.913+0000 7f6a327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 0x7f6a340c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.914+0000 7f6a327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 0x7f6a340c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40186/0 (socket says 172.21.15.46:40186) 2024-01-27T14:59:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.914+0000 7f6a327fc640 1 -- 172.21.15.46:0/1892149243 learned_addr learned my addr 172.21.15.46:0/1892149243 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:48.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.916+0000 7f6a32ffd640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a34071190 0x7f6a341ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.918+0000 7f6a327fc640 1 -- 172.21.15.46:0/1892149243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a341507e0 msgr2=0x7f6a34159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.918+0000 7f6a327fc640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a341507e0 0x7f6a34159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.918+0000 7f6a327fc640 1 -- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a34071190 msgr2=0x7f6a341ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.918+0000 7f6a327fc640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a34071190 0x7f6a341ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.918+0000 7f6a327fc640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009400 con 0x7f6a34072450 2024-01-27T14:59:48.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.921+0000 7f6a327fc640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 0x7f6a340c9980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c530 tx=0x7f6a2800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.925+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28005ce0 con 0x7f6a34072450 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.925+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28005e40 con 0x7f6a34072450 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.925+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280072b0 con 0x7f6a34072450 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.925+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a341ed7a0 con 0x7f6a34072450 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.925+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341edd40 con 0x7f6a34072450 2024-01-27T14:59:48.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.926+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a340b0770 con 0x7f6a34072450 2024-01-27T14:59:48.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.946+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6a28007410 con 0x7f6a34072450 2024-01-27T14:59:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.946+0000 7f6a1b7fe640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6a2006af20 0x7f6a2006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.946+0000 7f6a32ffd640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6a2006af20 0x7f6a2006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.947+0000 7f6a32ffd640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6a2006af20 0x7f6a2006d3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c036000 tx=0x7f6a2c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.950+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6a28058050 con 0x7f6a34072450 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.950+0000 7f6a1b7fe640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7f6a20074600 0x7f6a20076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.950+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a20077170 con 0x7f6a20074600 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.950+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a28054390 con 0x7f6a34072450 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.950+0000 7f6a337fe640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7f6a20074600 0x7f6a20076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.951+0000 7f6a337fe640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7f6a20074600 0x7f6a20076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.951+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== osd.0 v2:172.21.15.46:6803/4069301079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6a20077170 con 0x7f6a20074600 2024-01-27T14:59:48.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.964+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 --> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a3406fb60 con 0x7f6a20074600 2024-01-27T14:59:48.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a1b7fe640 1 -- 172.21.15.46:0/1892149243 <== osd.0 v2:172.21.15.46:6803/4069301079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6a3406fb60 con 0x7f6a20074600 2024-01-27T14:59:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:48.967 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7f6a20074600 msgr2=0x7f6a20076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6803/4069301079,v1:172.21.15.46:6806/4069301079] conn(0x7f6a20074600 0x7f6a20076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6a2006af20 msgr2=0x7f6a2006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f6a2006af20 0x7f6a2006d3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c036000 tx=0x7f6a2c008030 comp rx=0 tx=0).stop 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 msgr2=0x7f6a340c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 --2- 172.21.15.46:0/1892149243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a34072450 0x7f6a340c9980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c530 tx=0x7f6a2800c9f0 comp rx=0 tx=0).stop 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a337fe640 1 -- 172.21.15.46:0/1892149243 reap_dead start 2024-01-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 shutdown_connections 2024-01-27T14:59:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 >> 172.21.15.46:0/1892149243 conn(0x7f6a340c7a00 msgr2=0x7f6a340c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 shutdown_connections 2024-01-27T14:59:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:48.965+0000 7f6a39756640 1 -- 172.21.15.46:0/1892149243 wait complete. 2024-01-27T14:59:48.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-27T14:59:49.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.078+0000 7f6779bcf640 1 Processor -- start 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.078+0000 7f6779bcf640 1 -- start start 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.079+0000 7f6779bcf640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f677415a3c0 0x7f67740cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.079+0000 7f6779bcf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67740cc2c0 0x7f67740b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.079+0000 7f6779bcf640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740cc730 con 0x7f6774153a20 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.079+0000 7f6779bcf640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677406cdc0 con 0x7f677415a3c0 2024-01-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.079+0000 7f6779bcf640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677406bed0 con 0x7f67740cc2c0 2024-01-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.080+0000 7f6772ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f677415a3c0 0x7f67740cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.080+0000 7f6773fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67740cc2c0 0x7f67740b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.080+0000 7f6773fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67740cc2c0 0x7f67740b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40194/0 (socket says 172.21.15.46:40194) 2024-01-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.080+0000 7f6773fff640 1 -- 172.21.15.46:0/3227414297 learned_addr learned my addr 172.21.15.46:0/3227414297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.083+0000 7f6773fff640 1 -- 172.21.15.46:0/3227414297 >> v2:172.21.15.46:3300/0 conn(0x7f677415a3c0 msgr2=0x7f67740cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:49.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.083+0000 7f6773fff640 1 --2- 172.21.15.46:0/3227414297 >> v2:172.21.15.46:3300/0 conn(0x7f677415a3c0 0x7f67740cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.083+0000 7f6773fff640 1 -- 172.21.15.46:0/3227414297 >> v1:172.21.15.46:6789/0 conn(0x7f6774153a20 legacy=0x7f67740ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.083+0000 7f6773fff640 1 -- 172.21.15.46:0/3227414297 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677406c1b0 con 0x7f67740cc2c0 2024-01-27T14:59:49.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.085+0000 7f6773fff640 1 --2- 172.21.15.46:0/3227414297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740b34f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67740b28c0 tx=0x7f676c02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2629098807fa058 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.089+0000 7f67727fc640 1 -- 172.21.15.46:0/3227414297 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c02cbb0 con 0x7f67740cc2c0 2024-01-27T14:59:49.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.089+0000 7f67727fc640 1 -- 172.21.15.46:0/3227414297 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c02cd10 con 0x7f67740cc2c0 2024-01-27T14:59:49.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.089+0000 7f67727fc640 1 -- 172.21.15.46:0/3227414297 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c034610 con 0x7f67740cc2c0 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 -- 172.21.15.46:0/3227414297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 msgr2=0x7f67740b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3227414297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740b34f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67740b28c0 tx=0x7f676c02c010 comp rx=0 tx=0).stop 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 -- 172.21.15.46:0/3227414297 shutdown_connections 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3227414297 >> v2:172.21.15.46:3300/0 conn(0x7f677415a3c0 0x7f67740cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3227414297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740b34f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 -- 172.21.15.46:0/3227414297 >> 172.21.15.46:0/3227414297 conn(0x7f6774071fd0 msgr2=0x7f67740723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:49.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 -- 172.21.15.46:0/3227414297 shutdown_connections 2024-01-27T14:59:49.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.090+0000 7f6779bcf640 1 -- 172.21.15.46:0/3227414297 wait complete. 2024-01-27T14:59:49.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.091+0000 7f6779bcf640 1 Processor -- start 2024-01-27T14:59:49.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.091+0000 7f6779bcf640 1 -- start start 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 0x7f67741f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f677415a3c0 0x7f67741544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677415b580 con 0x7f6774153a20 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67741f2e80 con 0x7f67740cc2c0 2024-01-27T14:59:49.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.092+0000 7f6779bcf640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741f2b50 con 0x7f677415a3c0 2024-01-27T14:59:49.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.093+0000 7f67737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.093+0000 7f6773fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f677415a3c0 0x7f67741544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.093+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 0x7f67741f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.093+0000 7f67737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40202/0 (socket says 172.21.15.46:40202) 2024-01-27T14:59:49.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.093+0000 7f67737fe640 1 -- 172.21.15.46:0/3022501272 learned_addr learned my addr 172.21.15.46:0/3022501272 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.097+0000 7f6772ffd640 1 -- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f677415a3c0 msgr2=0x7f67741544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.097+0000 7f6772ffd640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f677415a3c0 0x7f67741544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.097+0000 7f6772ffd640 1 -- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 msgr2=0x7f67740ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.097+0000 7f6772ffd640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.097+0000 7f6772ffd640 1 -- 172.21.15.46:0/3022501272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009b30 con 0x7f6774153a20 2024-01-27T14:59:49.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.099+0000 7f6772ffd640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 0x7f67741f3310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f676800e870 tx=0x7f676800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.103+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800ee60 con 0x7f6774153a20 2024-01-27T14:59:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.103+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800c940 con 0x7f6774153a20 2024-01-27T14:59:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.103+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800ccd0 con 0x7f6774153a20 2024-01-27T14:59:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.103+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677415cc20 con 0x7f6774153a20 2024-01-27T14:59:49.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.103+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677415d1e0 con 0x7f6774153a20 2024-01-27T14:59:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.104+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677414daa0 con 0x7f6774153a20 2024-01-27T14:59:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.123+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6768013470 con 0x7f6774153a20 2024-01-27T14:59:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.124+0000 7f675bfff640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 0x7f676006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.124+0000 7f67737fe640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 0x7f676006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.124+0000 7f67737fe640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 0x7f676006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6764001840 tx=0x7f6764009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.386+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f676800ce30 con 0x7f6774153a20 2024-01-27T14:59:49.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.386+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6768054d00 con 0x7f6774153a20 2024-01-27T14:59:49.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.594+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f677406ca50 con 0x7f676006aed0 2024-01-27T14:59:49.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.595+0000 7f675bfff640 1 -- 172.21.15.46:0/3022501272 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f67640014e0 con 0x7f676006aed0 2024-01-27T14:59:49.597 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 msgr2=0x7f676006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 0x7f676006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6764001840 tx=0x7f6764009040 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 msgr2=0x7f67741f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 0x7f67741f3310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f676800e870 tx=0x7f676800ed30 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 shutdown_connections 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f676006aed0 0x7f676006d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f677415a3c0 0x7f67741544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6774153a20 0x7f67741f3310 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 --2- 172.21.15.46:0/3022501272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67740cc2c0 0x7f67740ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 >> 172.21.15.46:0/3022501272 conn(0x7f6774071fd0 msgr2=0x7f67740c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 shutdown_connections 2024-01-27T14:59:49.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.597+0000 7f6779bcf640 1 -- 172.21.15.46:0/3022501272 wait complete. 2024-01-27T14:59:49.610 INFO:tasks.ceph:Scrubbing osd.1 2024-01-27T14:59:49.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:49.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.714+0000 7fdb6cf0d640 1 Processor -- start 2024-01-27T14:59:49.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.714+0000 7fdb6cf0d640 1 -- start start 2024-01-27T14:59:49.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.715+0000 7fdb6cf0d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb68151810 0x7fdb680ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.715+0000 7fdb6cf0d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb680c9380 0x7fdb6815b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.715+0000 7fdb6cf0d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6815aad0 con 0x7fdb680ca3d0 2024-01-27T14:59:49.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.715+0000 7fdb6cf0d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb68158500 con 0x7fdb68151810 2024-01-27T14:59:49.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.715+0000 7fdb6cf0d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb680c97d0 con 0x7fdb680c9380 2024-01-27T14:59:49.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.716+0000 7fdb6659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb68151810 0x7fdb680ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.716+0000 7fdb6659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb68151810 0x7fdb680ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33798/0 (socket says 172.21.15.46:33798) 2024-01-27T14:59:49.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.716+0000 7fdb6659c640 1 -- 172.21.15.46:0/4104040502 learned_addr learned my addr 172.21.15.46:0/4104040502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.716+0000 7fdb66d9d640 1 --2- 172.21.15.46:0/4104040502 >> v2:172.21.15.73:3300/0 conn(0x7fdb680c9380 0x7fdb6815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.718+0000 7fdb6659c640 1 -- 172.21.15.46:0/4104040502 >> v2:172.21.15.73:3300/0 conn(0x7fdb680c9380 msgr2=0x7fdb6815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.718+0000 7fdb6659c640 1 --2- 172.21.15.46:0/4104040502 >> v2:172.21.15.73:3300/0 conn(0x7fdb680c9380 0x7fdb6815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.718+0000 7fdb6659c640 1 -- 172.21.15.46:0/4104040502 >> v1:172.21.15.73:6789/0 conn(0x7fdb680ca3d0 legacy=0x7fdb68070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.718+0000 7fdb6659c640 1 -- 172.21.15.46:0/4104040502 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6815b090 con 0x7fdb68151810 2024-01-27T14:59:49.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.720+0000 7fdb6659c640 1 --2- 172.21.15.46:0/4104040502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb68151810 0x7fdb680ccd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb6806f090 tx=0x7fdb6002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee8f63ba55a4fe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6559a640 1 -- 172.21.15.46:0/4104040502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6002f850 con 0x7fdb68151810 2024-01-27T14:59:49.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6559a640 1 -- 172.21.15.46:0/4104040502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6002f9b0 con 0x7fdb68151810 2024-01-27T14:59:49.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6559a640 1 -- 172.21.15.46:0/4104040502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6002fd40 con 0x7fdb68151810 2024-01-27T14:59:49.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/4104040502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb68151810 msgr2=0x7fdb680ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/4104040502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb68151810 0x7fdb680ccd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb6806f090 tx=0x7fdb6002ba30 comp rx=0 tx=0).stop 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/4104040502 shutdown_connections 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/4104040502 >> v2:172.21.15.73:3300/0 conn(0x7fdb680c9380 0x7fdb6815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/4104040502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb68151810 0x7fdb680ccd10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/4104040502 >> 172.21.15.46:0/4104040502 conn(0x7fdb68066c80 msgr2=0x7fdb6806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/4104040502 shutdown_connections 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.724+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/4104040502 wait complete. 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 Processor -- start 2024-01-27T14:59:49.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 -- start start 2024-01-27T14:59:49.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb680c9380 0x7fdb681e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 0x7fdb680cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb68151810 0x7fdb681ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb681ecfe0 con 0x7fdb680ca3d0 2024-01-27T14:59:49.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb681e0ca0 con 0x7fdb68151810 2024-01-27T14:59:49.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.726+0000 7fdb6cf0d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb680cd450 con 0x7fdb680c9380 2024-01-27T14:59:49.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.727+0000 7fdb65d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 0x7fdb680cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.727+0000 7fdb66d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb68151810 0x7fdb681ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.727+0000 7fdb6659c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb680c9380 0x7fdb681e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.727+0000 7fdb65d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 0x7fdb680cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33812/0 (socket says 172.21.15.46:33812) 2024-01-27T14:59:49.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.727+0000 7fdb65d9b640 1 -- 172.21.15.46:0/3474097133 learned_addr learned my addr 172.21.15.46:0/3474097133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.731+0000 7fdb65d9b640 1 -- 172.21.15.46:0/3474097133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb680c9380 msgr2=0x7fdb681e1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.731+0000 7fdb65d9b640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb680c9380 0x7fdb681e1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.731+0000 7fdb65d9b640 1 -- 172.21.15.46:0/3474097133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb68151810 msgr2=0x7fdb681ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.731+0000 7fdb65d9b640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb68151810 0x7fdb681ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.731+0000 7fdb65d9b640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600094d0 con 0x7fdb680ca3d0 2024-01-27T14:59:49.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.733+0000 7fdb65d9b640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 0x7fdb680cc3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c440 tx=0x7fdb50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.736+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500052d0 con 0x7fdb680ca3d0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.737+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50005430 con 0x7fdb680ca3d0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.737+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb680cd730 con 0x7fdb680ca3d0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.737+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007260 con 0x7fdb680ca3d0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.737+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb680cda10 con 0x7fdb680ca3d0 2024-01-27T14:59:49.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.738+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb68151c50 con 0x7fdb680ca3d0 2024-01-27T14:59:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.757+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb500073c0 con 0x7fdb680ca3d0 2024-01-27T14:59:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.758+0000 7fdb5effd640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdb4806af20 0x7fdb4806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.758+0000 7fdb6659c640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdb4806af20 0x7fdb4806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.758+0000 7fdb6659c640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdb4806af20 0x7fdb4806d3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb60036000 tx=0x7fdb60008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.760+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fdb50058100 con 0x7fdb680ca3d0 2024-01-27T14:59:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.760+0000 7fdb5effd640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7fdb48074600 0x7fdb48076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.760+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb48077170 con 0x7fdb48074600 2024-01-27T14:59:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.760+0000 7fdb66d9d640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7fdb48074600 0x7fdb48076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.760+0000 7fdb66d9d640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7fdb48074600 0x7fdb48076aa0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.761+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== osd.1 v2:172.21.15.46:6802/1737720199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdb48077170 con 0x7fdb48074600 2024-01-27T14:59:49.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.761+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb50001140 con 0x7fdb680ca3d0 2024-01-27T14:59:49.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.774+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 --> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdb68158220 con 0x7fdb48074600 2024-01-27T14:59:49.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb5effd640 1 -- 172.21.15.46:0/3474097133 <== osd.1 v2:172.21.15.46:6802/1737720199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdb5800f040 con 0x7fdb48074600 2024-01-27T14:59:49.776 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:49.777 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:49.777 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7fdb48074600 msgr2=0x7fdb48076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6802/1737720199,v1:172.21.15.46:6804/1737720199] conn(0x7fdb48074600 0x7fdb48076aa0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdb4806af20 msgr2=0x7fdb4806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdb4806af20 0x7fdb4806d3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb60036000 tx=0x7fdb60008030 comp rx=0 tx=0).stop 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 msgr2=0x7fdb680cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 --2- 172.21.15.46:0/3474097133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb680ca3d0 0x7fdb680cc3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c440 tx=0x7fdb50001e70 comp rx=0 tx=0).stop 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb66d9d640 1 -- 172.21.15.46:0/3474097133 reap_dead start 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 shutdown_connections 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 >> 172.21.15.46:0/3474097133 conn(0x7fdb68066c80 msgr2=0x7fdb68070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 shutdown_connections 2024-01-27T14:59:49.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.775+0000 7fdb6cf0d640 1 -- 172.21.15.46:0/3474097133 wait complete. 2024-01-27T14:59:49.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-27T14:59:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.888+0000 7f2c4b35d640 1 Processor -- start 2024-01-27T14:59:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.888+0000 7f2c4b35d640 1 -- start start 2024-01-27T14:59:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c4b35d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c4408bb90 0x7f2c4415a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c4b35d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c4415ada0 0x7f2c4415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c4b35d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4415b730 con 0x7f2c44153b50 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c4b35d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4408bfd0 con 0x7f2c4415ada0 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c4b35d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440c9ce0 con 0x7f2c4408bb90 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.889+0000 7f2c498fa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c4415ada0 0x7f2c4415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.890+0000 7f2c498fa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2c4415ada0 0x7f2c4415b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33814/0 (socket says 172.21.15.46:33814) 2024-01-27T14:59:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.890+0000 7f2c498fa640 1 -- 172.21.15.46:0/673036945 learned_addr learned my addr 172.21.15.46:0/673036945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.891+0000 7f2c488f8640 1 --2- 172.21.15.46:0/673036945 >> v2:172.21.15.73:3300/0 conn(0x7f2c4408bb90 0x7f2c4415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.892+0000 7f2c498fa640 1 -- 172.21.15.46:0/673036945 >> v2:172.21.15.73:3300/0 conn(0x7f2c4408bb90 msgr2=0x7f2c4415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.892+0000 7f2c498fa640 1 --2- 172.21.15.46:0/673036945 >> v2:172.21.15.73:3300/0 conn(0x7f2c4408bb90 0x7f2c4415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.892+0000 7f2c498fa640 1 -- 172.21.15.46:0/673036945 >> v1:172.21.15.73:6789/0 conn(0x7f2c44153b50 legacy=0x7f2c440cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.892+0000 7f2c498fa640 1 -- 172.21.15.46:0/673036945 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440c3e90 con 0x7f2c4415ada0 2024-01-27T14:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.894+0000 7f2c498fa640 1 --2- 172.21.15.46:0/673036945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4415ada0 0x7f2c4415b1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2c4406d8f0 tx=0x7f2c3c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f76fa6ffab1456 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.897+0000 7f2c3bfff640 1 -- 172.21.15.46:0/673036945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c02cb20 con 0x7f2c4415ada0 2024-01-27T14:59:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c3bfff640 1 -- 172.21.15.46:0/673036945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02cc80 con 0x7f2c4415ada0 2024-01-27T14:59:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c3bfff640 1 -- 172.21.15.46:0/673036945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0343f0 con 0x7f2c4415ada0 2024-01-27T14:59:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 -- 172.21.15.46:0/673036945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4415ada0 msgr2=0x7f2c4415b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/673036945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4415ada0 0x7f2c4415b1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2c4406d8f0 tx=0x7f2c3c02bf80 comp rx=0 tx=0).stop 2024-01-27T14:59:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 -- 172.21.15.46:0/673036945 shutdown_connections 2024-01-27T14:59:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/673036945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4415ada0 0x7f2c4415b1f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/673036945 >> v2:172.21.15.73:3300/0 conn(0x7f2c4408bb90 0x7f2c4415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 -- 172.21.15.46:0/673036945 >> 172.21.15.46:0/673036945 conn(0x7f2c4406cca0 msgr2=0x7f2c4406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 -- 172.21.15.46:0/673036945 shutdown_connections 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.898+0000 7f2c4b35d640 1 -- 172.21.15.46:0/673036945 wait complete. 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.899+0000 7f2c4b35d640 1 Processor -- start 2024-01-27T14:59:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 -- start start 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c44153b50 0x7f2c441f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 0x7f2c441e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441f2f80 con 0x7f2c4408bb90 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441f0580 con 0x7f2c4415ada0 2024-01-27T14:59:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.900+0000 7f2c4b35d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4414df70 con 0x7f2c44153b50 2024-01-27T14:59:49.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.901+0000 7f2c490f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.901+0000 7f2c498fa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 0x7f2c441e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.901+0000 7f2c488f8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c44153b50 0x7f2c441f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:49.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.901+0000 7f2c490f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33826/0 (socket says 172.21.15.46:33826) 2024-01-27T14:59:49.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.901+0000 7f2c490f9640 1 -- 172.21.15.46:0/782172209 learned_addr learned my addr 172.21.15.46:0/782172209 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c490f9640 1 -- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c44153b50 msgr2=0x7f2c441f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c490f9640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c44153b50 0x7f2c441f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c490f9640 1 -- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 msgr2=0x7f2c441e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c490f9640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 0x7f2c441e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c490f9640 1 -- 172.21.15.46:0/782172209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009b30 con 0x7f2c4408bb90 2024-01-27T14:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.905+0000 7f2c498fa640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 0x7f2c441e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:59:49.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.907+0000 7f2c490f9640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b3f0 tx=0x7f2c4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:49.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.911+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011830 con 0x7f2c4408bb90 2024-01-27T14:59:49.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.911+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40011990 con 0x7f2c4408bb90 2024-01-27T14:59:49.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.911+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4414e250 con 0x7f2c4408bb90 2024-01-27T14:59:49.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.911+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011d40 con 0x7f2c4408bb90 2024-01-27T14:59:49.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.912+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c441f2c10 con 0x7f2c4408bb90 2024-01-27T14:59:49.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:49.913+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c440742e0 con 0x7f2c4408bb90 2024-01-27T14:59:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.180+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2c40004020 con 0x7f2c4408bb90 2024-01-27T14:59:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.180+0000 7f2c39ffb640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 0x7f2c2806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.181+0000 7f2c488f8640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 0x7f2c2806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.181+0000 7f2c488f8640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 0x7f2c2806d3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c440b3a30 tx=0x7f2c34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.198+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2c40058430 con 0x7f2c4408bb90 2024-01-27T14:59:50.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.198+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2c40054770 con 0x7f2c4408bb90 2024-01-27T14:59:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.378+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c440c59f0 con 0x7f2c2806af20 2024-01-27T14:59:50.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.378+0000 7f2c39ffb640 1 -- 172.21.15.46:0/782172209 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c440c59f0 con 0x7f2c2806af20 2024-01-27T14:59:50.380 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 msgr2=0x7f2c2806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 0x7f2c2806d3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c440b3a30 tx=0x7f2c34008040 comp rx=0 tx=0).stop 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 msgr2=0x7f2c441f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b3f0 tx=0x7f2c4000b8b0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 shutdown_connections 2024-01-27T14:59:50.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f2c2806af20 0x7f2c2806d3e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4415ada0 0x7f2c441e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c44153b50 0x7f2c441f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 --2- 172.21.15.46:0/782172209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c4408bb90 0x7f2c441f0040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 >> 172.21.15.46:0/782172209 conn(0x7f2c4406cca0 msgr2=0x7f2c440cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 shutdown_connections 2024-01-27T14:59:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.380+0000 7f2c4b35d640 1 -- 172.21.15.46:0/782172209 wait complete. 2024-01-27T14:59:50.393 INFO:tasks.ceph:Scrubbing osd.2 2024-01-27T14:59:50.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:50.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.497+0000 7f34c17a2640 1 Processor -- start 2024-01-27T14:59:50.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 -- start start 2024-01-27T14:59:50.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f34bc153a20 0x7f34bc0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34bc0cc490 0x7f34bc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc06bed0 con 0x7f34bc15a3c0 2024-01-27T14:59:50.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc06cdc0 con 0x7f34bc153a20 2024-01-27T14:59:50.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.498+0000 7f34c17a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc06c1b0 con 0x7f34bc0cc490 2024-01-27T14:59:50.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.499+0000 7f34bb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34bc0cc490 0x7f34bc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.499+0000 7f34bb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34bc0cc490 0x7f34bc0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40234/0 (socket says 172.21.15.46:40234) 2024-01-27T14:59:50.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.499+0000 7f34bb7fe640 1 -- 172.21.15.46:0/1119002042 learned_addr learned my addr 172.21.15.46:0/1119002042 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:50.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.503+0000 7f34bb7fe640 1 -- 172.21.15.46:0/1119002042 >> v2:172.21.15.46:3300/0 conn(0x7f34bc153a20 msgr2=0x7f34bc0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:50.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.503+0000 7f34bb7fe640 1 --2- 172.21.15.46:0/1119002042 >> v2:172.21.15.46:3300/0 conn(0x7f34bc153a20 0x7f34bc0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.503+0000 7f34bb7fe640 1 -- 172.21.15.46:0/1119002042 >> v1:172.21.15.73:6789/0 conn(0x7f34bc15a3c0 legacy=0x7f34bc0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.503+0000 7f34bb7fe640 1 -- 172.21.15.46:0/1119002042 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc06c490 con 0x7f34bc0cc490 2024-01-27T14:59:50.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.508+0000 7f34bb7fe640 1 --2- 172.21.15.46:0/1119002042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc0cc490 0x7f34bc0ca590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0b28c0 tx=0x7f34b402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae3975f3c43111f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.565+0000 7f34b9ffb640 1 -- 172.21.15.46:0/1119002042 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b402cbb0 con 0x7f34bc0cc490 2024-01-27T14:59:50.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.565+0000 7f34b9ffb640 1 -- 172.21.15.46:0/1119002042 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b402cd10 con 0x7f34bc0cc490 2024-01-27T14:59:50.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.565+0000 7f34b9ffb640 1 -- 172.21.15.46:0/1119002042 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4034610 con 0x7f34bc0cc490 2024-01-27T14:59:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 -- 172.21.15.46:0/1119002042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc0cc490 msgr2=0x7f34bc0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 --2- 172.21.15.46:0/1119002042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc0cc490 0x7f34bc0ca590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0b28c0 tx=0x7f34b402c010 comp rx=0 tx=0).stop 2024-01-27T14:59:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 -- 172.21.15.46:0/1119002042 shutdown_connections 2024-01-27T14:59:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 --2- 172.21.15.46:0/1119002042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc0cc490 0x7f34bc0ca590 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 --2- 172.21.15.46:0/1119002042 >> v2:172.21.15.46:3300/0 conn(0x7f34bc153a20 0x7f34bc0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 -- 172.21.15.46:0/1119002042 >> 172.21.15.46:0/1119002042 conn(0x7f34bc071fd0 msgr2=0x7f34bc0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:50.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 -- 172.21.15.46:0/1119002042 shutdown_connections 2024-01-27T14:59:50.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.566+0000 7f34c17a2640 1 -- 172.21.15.46:0/1119002042 wait complete. 2024-01-27T14:59:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.567+0000 7f34c17a2640 1 Processor -- start 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 -- start start 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34bc0cc490 0x7f34bc145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc153a20 0x7f34bc146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 0x7f34bc0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0c7020 con 0x7f34bc15a3c0 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15d4c0 con 0x7f34bc153a20 2024-01-27T14:59:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.568+0000 7f34c17a2640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc159530 con 0x7f34bc0cc490 2024-01-27T14:59:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.569+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 0x7f34bc0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.569+0000 7f34ba7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc153a20 0x7f34bc146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.569+0000 7f34baffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34bc0cc490 0x7f34bc145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.569+0000 7f34bb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 0x7f34bc0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33846/0 (socket says 172.21.15.46:33846) 2024-01-27T14:59:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.569+0000 7f34bb7fe640 1 -- 172.21.15.46:0/2465805743 learned_addr learned my addr 172.21.15.46:0/2465805743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.573+0000 7f34bb7fe640 1 -- 172.21.15.46:0/2465805743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34bc0cc490 msgr2=0x7f34bc145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.573+0000 7f34bb7fe640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34bc0cc490 0x7f34bc145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.573+0000 7f34bb7fe640 1 -- 172.21.15.46:0/2465805743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc153a20 msgr2=0x7f34bc146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.573+0000 7f34bb7fe640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34bc153a20 0x7f34bc146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.573+0000 7f34bb7fe640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4009b30 con 0x7f34bc15a3c0 2024-01-27T14:59:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.575+0000 7f34bb7fe640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 0x7f34bc0c7440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f34b4036040 tx=0x7f34b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.578+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b403e450 con 0x7f34bc15a3c0 2024-01-27T14:59:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.578+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b403e5d0 con 0x7f34bc15a3c0 2024-01-27T14:59:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.578+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b403e980 con 0x7f34bc15a3c0 2024-01-27T14:59:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.579+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc153f80 con 0x7f34bc15a3c0 2024-01-27T14:59:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.579+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc0c6c40 con 0x7f34bc15a3c0 2024-01-27T14:59:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.579+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34bc153e00 con 0x7f34bc15a3c0 2024-01-27T14:59:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.598+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f34b403eae0 con 0x7f34bc15a3c0 2024-01-27T14:59:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.598+0000 7f34a37fe640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f34a806af20 0x7f34a806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.599+0000 7f34baffd640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f34a806af20 0x7f34a806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.599+0000 7f34baffd640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f34a806af20 0x7f34a806d3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009990 tx=0x7f34b0009110 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f34b407bf00 con 0x7f34bc15a3c0 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34a37fe640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7f34a8074680 0x7f34a8076b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34a80771f0 con 0x7f34a8074680 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34b4077b40 con 0x7f34bc15a3c0 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34ba7fc640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7f34a8074680 0x7f34a8076b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.605+0000 7f34ba7fc640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7f34a8074680 0x7f34a8076b20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.606+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== osd.2 v2:172.21.15.46:6805/3503918932 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f34a80771f0 con 0x7f34a8074680 2024-01-27T14:59:50.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.619+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 --> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34bc06ca50 con 0x7f34a8074680 2024-01-27T14:59:50.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34a37fe640 1 -- 172.21.15.46:0/2465805743 <== osd.2 v2:172.21.15.46:6805/3503918932 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f34ac001810 con 0x7f34a8074680 2024-01-27T14:59:50.622 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:50.622 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:50.622 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7f34a8074680 msgr2=0x7f34a8076b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6805/3503918932,v1:172.21.15.46:6808/3503918932] conn(0x7f34a8074680 0x7f34a8076b20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f34a806af20 msgr2=0x7f34a806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f34a806af20 0x7f34a806d3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009990 tx=0x7f34b0009110 comp rx=0 tx=0).stop 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 msgr2=0x7f34bc0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 --2- 172.21.15.46:0/2465805743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc15a3c0 0x7f34bc0c7440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f34b4036040 tx=0x7f34b4004a40 comp rx=0 tx=0).stop 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34bb7fe640 1 -- 172.21.15.46:0/2465805743 reap_dead start 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 shutdown_connections 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 >> 172.21.15.46:0/2465805743 conn(0x7f34bc071fd0 msgr2=0x7f34bc0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 shutdown_connections 2024-01-27T14:59:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.620+0000 7f34c17a2640 1 -- 172.21.15.46:0/2465805743 wait complete. 2024-01-27T14:59:50.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-27T14:59:50.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.732+0000 7faae7c56640 1 Processor -- start 2024-01-27T14:59:50.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 -- start start 2024-01-27T14:59:50.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae00710f0 0x7faae00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00714d0 0x7faae015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faae00c93b0 0x7faae015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae00ca870 con 0x7faae00710f0 2024-01-27T14:59:50.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae00c7ba0 con 0x7faae00c93b0 2024-01-27T14:59:50.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.733+0000 7faae7c56640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae0159a60 con 0x7faae00714d0 2024-01-27T14:59:50.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.734+0000 7faae51f1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00714d0 0x7faae015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.734+0000 7faae61f3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faae00c93b0 0x7faae015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.734+0000 7faae59f2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae00710f0 0x7faae00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.734+0000 7faae59f2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae00710f0 0x7faae00ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33862/0 (socket says 172.21.15.46:33862) 2024-01-27T14:59:50.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.735+0000 7faae59f2640 1 -- 172.21.15.46:0/862982806 learned_addr learned my addr 172.21.15.46:0/862982806 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:50.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.737+0000 7faae59f2640 1 -- 172.21.15.46:0/862982806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00714d0 msgr2=0x7faae015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:50.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.737+0000 7faae59f2640 1 --2- 172.21.15.46:0/862982806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00714d0 0x7faae015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.737+0000 7faae59f2640 1 -- 172.21.15.46:0/862982806 >> v2:172.21.15.73:3300/0 conn(0x7faae00c93b0 msgr2=0x7faae015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:50.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.737+0000 7faae59f2640 1 --2- 172.21.15.46:0/862982806 >> v2:172.21.15.73:3300/0 conn(0x7faae00c93b0 0x7faae015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.737+0000 7faae59f2640 1 -- 172.21.15.46:0/862982806 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0159d40 con 0x7faae00710f0 2024-01-27T14:59:50.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.739+0000 7faae59f2640 1 --2- 172.21.15.46:0/862982806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00ca330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faae0070b00 tx=0x7faadc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33349a63b83684bb server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.742+0000 7faae49f0640 1 -- 172.21.15.46:0/862982806 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc030860 con 0x7faae00710f0 2024-01-27T14:59:50.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae49f0640 1 -- 172.21.15.46:0/862982806 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc0309c0 con 0x7faae00710f0 2024-01-27T14:59:50.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae49f0640 1 -- 172.21.15.46:0/862982806 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc030d50 con 0x7faae00710f0 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 -- 172.21.15.46:0/862982806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 msgr2=0x7faae00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 --2- 172.21.15.46:0/862982806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00ca330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faae0070b00 tx=0x7faadc02b9a0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 -- 172.21.15.46:0/862982806 shutdown_connections 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 --2- 172.21.15.46:0/862982806 >> v2:172.21.15.73:3300/0 conn(0x7faae00c93b0 0x7faae015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 --2- 172.21.15.46:0/862982806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00714d0 0x7faae015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 --2- 172.21.15.46:0/862982806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00ca330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 -- 172.21.15.46:0/862982806 >> 172.21.15.46:0/862982806 conn(0x7faae0066ac0 msgr2=0x7faae006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 -- 172.21.15.46:0/862982806 shutdown_connections 2024-01-27T14:59:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.743+0000 7faae7c56640 1 -- 172.21.15.46:0/862982806 wait complete. 2024-01-27T14:59:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.744+0000 7faae7c56640 1 Processor -- start 2024-01-27T14:59:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 -- start start 2024-01-27T14:59:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faae00714d0 0x7faae01eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00c93b0 0x7faae0156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c5500 con 0x7faae00710f0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c4830 con 0x7faae00714d0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.745+0000 7faae7c56640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae0153bd0 con 0x7faae00c93b0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.746+0000 7faae59f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.746+0000 7faae61f3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00c93b0 0x7faae0156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.746+0000 7faae51f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faae00714d0 0x7faae01eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.746+0000 7faae59f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33876/0 (socket says 172.21.15.46:33876) 2024-01-27T14:59:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.746+0000 7faae59f2640 1 -- 172.21.15.46:0/1428491546 learned_addr learned my addr 172.21.15.46:0/1428491546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.750+0000 7faae59f2640 1 -- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00c93b0 msgr2=0x7faae0156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.750+0000 7faae59f2640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00c93b0 0x7faae0156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.750+0000 7faae59f2640 1 -- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faae00714d0 msgr2=0x7faae01eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.750+0000 7faae59f2640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faae00714d0 0x7faae01eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.750+0000 7faae59f2640 1 -- 172.21.15.46:0/1428491546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0094d0 con 0x7faae00710f0 2024-01-27T14:59:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.752+0000 7faae59f2640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faadc000c00 tx=0x7faadc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.756+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc039c90 con 0x7faae00710f0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.756+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc039df0 con 0x7faae00710f0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.756+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00c4d60 con 0x7faae00710f0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.756+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc043640 con 0x7faae00710f0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.756+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae01ef850 con 0x7faae00710f0 2024-01-27T14:59:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.757+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae00c6460 con 0x7faae00710f0 2024-01-27T14:59:50.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.776+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faadc0437a0 con 0x7faae00710f0 2024-01-27T14:59:50.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.777+0000 7faad67fc640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 0x7faac406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:50.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.777+0000 7faae51f1640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 0x7faac406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:50.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:50.777+0000 7faae51f1640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 0x7faac406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faae01e93d0 tx=0x7faad0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.066+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7faadc03e070 con 0x7faae00710f0 2024-01-27T14:59:51.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.066+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7faadc077d80 con 0x7faae00710f0 2024-01-27T14:59:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.250+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7faae015cda0 con 0x7faac406af00 2024-01-27T14:59:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.250+0000 7faad67fc640 1 -- 172.21.15.46:0/1428491546 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faad0011a30 con 0x7faac406af00 2024-01-27T14:59:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-01-27T14:59:51.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 msgr2=0x7faac406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 0x7faac406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faae01e93d0 tx=0x7faad0009190 comp rx=0 tx=0).stop 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 msgr2=0x7faae00c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faadc000c00 tx=0x7faadc004730 comp rx=0 tx=0).stop 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 shutdown_connections 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7faac406af00 0x7faac406d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faae00714d0 0x7faae01eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae00c93b0 0x7faae0156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 --2- 172.21.15.46:0/1428491546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00710f0 0x7faae00c6740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 >> 172.21.15.46:0/1428491546 conn(0x7faae0066ac0 msgr2=0x7faae00c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 shutdown_connections 2024-01-27T14:59:51.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.252+0000 7faae7c56640 1 -- 172.21.15.46:0/1428491546 wait complete. 2024-01-27T14:59:51.266 INFO:tasks.ceph:Scrubbing osd.3 2024-01-27T14:59:51.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.369+0000 7f8d17eda640 1 Processor -- start 2024-01-27T14:59:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 -- start start 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d10153a20 0x7f8d100ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d100ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1006bed0 con 0x7f8d100cbd80 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1006cdc0 con 0x7f8d10153a20 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.370+0000 7f8d17eda640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1006c1b0 con 0x7f8d1015a3c0 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.371+0000 7f8d15475640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d100ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.371+0000 7f8d16477640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8d100cbd80 0x7f8d100b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:35356/0 (socket says 172.21.15.46:35356) 2024-01-27T14:59:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.371+0000 7f8d16477640 1 -- 172.21.15.46:0/4011352148 learned_addr learned my addr 172.21.15.46:0/4011352148 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d14c74640 1 -- 172.21.15.46:0/4011352148 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602997715 0 0) 0x7f8d1006bed0 con 0x7f8d100cbd80 2024-01-27T14:59:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d14c74640 1 -- 172.21.15.46:0/4011352148 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cfc003520 con 0x7f8d100cbd80 2024-01-27T14:59:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d15475640 1 -- 172.21.15.46:0/4011352148 >> v2:172.21.15.46:3300/0 conn(0x7f8d10153a20 msgr2=0x7f8d100ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d15475640 1 --2- 172.21.15.46:0/4011352148 >> v2:172.21.15.46:3300/0 conn(0x7f8d10153a20 0x7f8d100ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d15475640 1 -- 172.21.15.46:0/4011352148 >> v1:172.21.15.73:6789/0 conn(0x7f8d100cbd80 legacy=0x7f8d100b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.374+0000 7f8d15475640 1 -- 172.21.15.46:0/4011352148 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1006c490 con 0x7f8d1015a3c0 2024-01-27T14:59:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.377+0000 7f8d15475640 1 --2- 172.21.15.46:0/4011352148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d100ca590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0fd99844f17029 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.382+0000 7f8d14c74640 1 -- 172.21.15.46:0/4011352148 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00030610 con 0x7f8d1015a3c0 2024-01-27T14:59:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d14c74640 1 -- 172.21.15.46:0/4011352148 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00030770 con 0x7f8d1015a3c0 2024-01-27T14:59:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d14c74640 1 -- 172.21.15.46:0/4011352148 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00030b00 con 0x7f8d1015a3c0 2024-01-27T14:59:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 -- 172.21.15.46:0/4011352148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 msgr2=0x7f8d100ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 --2- 172.21.15.46:0/4011352148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d100ca590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b960 comp rx=0 tx=0).stop 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 -- 172.21.15.46:0/4011352148 shutdown_connections 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 --2- 172.21.15.46:0/4011352148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d100ca590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 --2- 172.21.15.46:0/4011352148 >> v2:172.21.15.46:3300/0 conn(0x7f8d10153a20 0x7f8d100ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 -- 172.21.15.46:0/4011352148 >> 172.21.15.46:0/4011352148 conn(0x7f8d10071fd0 msgr2=0x7f8d100723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 -- 172.21.15.46:0/4011352148 shutdown_connections 2024-01-27T14:59:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.383+0000 7f8d17eda640 1 -- 172.21.15.46:0/4011352148 wait complete. 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.384+0000 7f8d17eda640 1 Processor -- start 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 -- start start 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d100cbd80 0x7f8d100c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d10153a20 0x7f8d10155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d10155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100c70c0 con 0x7f8d10153a20 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101ef960 con 0x7f8d100cbd80 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.385+0000 7f8d17eda640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101efc40 con 0x7f8d1015a3c0 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.386+0000 7f8d15475640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d10153a20 0x7f8d10155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.386+0000 7f8d15c76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d100cbd80 0x7f8d100c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.386+0000 7f8d16477640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d10155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.386+0000 7f8d15475640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d10153a20 0x7f8d10155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33882/0 (socket says 172.21.15.46:33882) 2024-01-27T14:59:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.386+0000 7f8d15475640 1 -- 172.21.15.46:0/2442963354 learned_addr learned my addr 172.21.15.46:0/2442963354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.389+0000 7f8d15c76640 1 -- 172.21.15.46:0/2442963354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 msgr2=0x7f8d10155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.390+0000 7f8d15c76640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d1015a3c0 0x7f8d10155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.390+0000 7f8d15c76640 1 -- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d10153a20 msgr2=0x7f8d10155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.390+0000 7f8d15c76640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d10153a20 0x7f8d10155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.390+0000 7f8d15c76640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00009400 con 0x7f8d100cbd80 2024-01-27T14:59:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.392+0000 7f8d15c76640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d100cbd80 0x7f8d100c6540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b3f0 tx=0x7f8d0c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.396+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c011830 con 0x7f8d100cbd80 2024-01-27T14:59:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.396+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c011990 con 0x7f8d100cbd80 2024-01-27T14:59:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.396+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10153f80 con 0x7f8d100cbd80 2024-01-27T14:59:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.396+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c011d40 con 0x7f8d100cbd80 2024-01-27T14:59:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.396+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d101f0200 con 0x7f8d100cbd80 2024-01-27T14:59:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.397+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d10153e00 con 0x7f8d100cbd80 2024-01-27T14:59:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.416+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d0c01a400 con 0x7f8d100cbd80 2024-01-27T14:59:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.416+0000 7f8d067fc640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8cf406af20 0x7f8cf406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.416+0000 7f8d15475640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8cf406af20 0x7f8cf406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.416+0000 7f8d15475640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8cf406af20 0x7f8cf406d3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d10156bd0 tx=0x7f8d0003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.419+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f8d0c058900 con 0x7f8d100cbd80 2024-01-27T14:59:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.419+0000 7f8d067fc640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f8cf4074600 0x7f8cf4076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.419+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cf4077170 con 0x7f8cf4074600 2024-01-27T14:59:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.419+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d0c009220 con 0x7f8d100cbd80 2024-01-27T14:59:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.420+0000 7f8d16477640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f8cf4074600 0x7f8cf4076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.420+0000 7f8d16477640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f8cf4074600 0x7f8cf4076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.421+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== osd.3 v2:172.21.15.46:6826/2789936740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8cf4077170 con 0x7f8cf4074600 2024-01-27T14:59:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.434+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 --> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d1006ca50 con 0x7f8cf4074600 2024-01-27T14:59:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.434+0000 7f8d067fc640 1 -- 172.21.15.46:0/2442963354 <== osd.3 v2:172.21.15.46:6826/2789936740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d08002030 con 0x7f8cf4074600 2024-01-27T14:59:51.437 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:51.437 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:51.437 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:51.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.434+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f8cf4074600 msgr2=0x7f8cf4076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.434+0000 7f8d17eda640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6826/2789936740,v1:172.21.15.46:6827/2789936740] conn(0x7f8cf4074600 0x7f8cf4076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8cf406af20 msgr2=0x7f8cf406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f8cf406af20 0x7f8cf406d3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d10156bd0 tx=0x7f8d0003b040 comp rx=0 tx=0).stop 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d100cbd80 msgr2=0x7f8d100c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 --2- 172.21.15.46:0/2442963354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d100cbd80 0x7f8d100c6540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b3f0 tx=0x7f8d0c00b8b0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d16477640 1 -- 172.21.15.46:0/2442963354 reap_dead start 2024-01-27T14:59:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 shutdown_connections 2024-01-27T14:59:51.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 >> 172.21.15.46:0/2442963354 conn(0x7f8d10071fd0 msgr2=0x7f8d10151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:51.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 shutdown_connections 2024-01-27T14:59:51.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.435+0000 7f8d17eda640 1 -- 172.21.15.46:0/2442963354 wait complete. 2024-01-27T14:59:51.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-27T14:59:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.551+0000 7f99db490640 1 Processor -- start 2024-01-27T14:59:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.551+0000 7f99db490640 1 -- start start 2024-01-27T14:59:51.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.553+0000 7f99db490640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d415a3c0 0x7f99d40cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.553+0000 7f99db490640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99d40cc2c0 0x7f99d40b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.553+0000 7f99db490640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40cc750 con 0x7f99d4153a20 2024-01-27T14:59:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.553+0000 7f99db490640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d406cdc0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.553+0000 7f99db490640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d406bed0 con 0x7f99d415a3c0 2024-01-27T14:59:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.569+0000 7f99d922c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f99d4153a20 0x7f99d40ca050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:35362/0 (socket says 172.21.15.46:35362) 2024-01-27T14:59:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.569+0000 7f99d922c640 1 -- 172.21.15.46:0/2710000493 learned_addr learned my addr 172.21.15.46:0/2710000493 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.569+0000 7f99d9a2d640 1 --2- 172.21.15.46:0/2710000493 >> v2:172.21.15.73:3300/0 conn(0x7f99d40cc2c0 0x7f99d40b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.570+0000 7f99d8a2b640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d415a3c0 0x7f99d40cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.574+0000 7f99d9a2d640 1 -- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d415a3c0 msgr2=0x7f99d40cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.574+0000 7f99d9a2d640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d415a3c0 0x7f99d40cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.574+0000 7f99d9a2d640 1 -- 172.21.15.46:0/2710000493 >> v1:172.21.15.73:6789/0 conn(0x7f99d4153a20 legacy=0x7f99d40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.574+0000 7f99d9a2d640 1 -- 172.21.15.46:0/2710000493 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d406c1b0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.579+0000 7f99d9a2d640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d40cc2c0 0x7f99d40b34f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009d90 tx=0x7f99cc02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89039feaf5e3d304 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99c7fff640 1 -- 172.21.15.46:0/2710000493 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc02cce0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99c7fff640 1 -- 172.21.15.46:0/2710000493 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc02ce40 con 0x7f99d40cc2c0 2024-01-27T14:59:51.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99c7fff640 1 -- 172.21.15.46:0/2710000493 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc034660 con 0x7f99d40cc2c0 2024-01-27T14:59:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 -- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d40cc2c0 msgr2=0x7f99d40b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d40cc2c0 0x7f99d40b34f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009d90 tx=0x7f99cc02bf30 comp rx=0 tx=0).stop 2024-01-27T14:59:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 -- 172.21.15.46:0/2710000493 shutdown_connections 2024-01-27T14:59:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d415a3c0 0x7f99d40cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 --2- 172.21.15.46:0/2710000493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d40cc2c0 0x7f99d40b34f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 -- 172.21.15.46:0/2710000493 >> 172.21.15.46:0/2710000493 conn(0x7f99d4071fd0 msgr2=0x7f99d40723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.583+0000 7f99db490640 1 -- 172.21.15.46:0/2710000493 shutdown_connections 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.584+0000 7f99db490640 1 -- 172.21.15.46:0/2710000493 wait complete. 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 Processor -- start 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 -- start start 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d4153a20 0x7f99d40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d415a3c0 0x7f99d41e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41e57e0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41f0550 con 0x7f99d415a3c0 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.585+0000 7f99db490640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41e52f0 con 0x7f99d4153a20 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.586+0000 7f99d922c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.586+0000 7f99d9a2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d415a3c0 0x7f99d41e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.586+0000 7f99d922c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33890/0 (socket says 172.21.15.46:33890) 2024-01-27T14:59:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.586+0000 7f99d922c640 1 -- 172.21.15.46:0/2947908011 learned_addr learned my addr 172.21.15.46:0/2947908011 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.586+0000 7f99d8a2b640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d4153a20 0x7f99d40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.590+0000 7f99d922c640 1 -- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d4153a20 msgr2=0x7f99d40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.590+0000 7f99d922c640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d4153a20 0x7f99d40cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.590+0000 7f99d922c640 1 -- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d415a3c0 msgr2=0x7f99d41e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.590+0000 7f99d922c640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d415a3c0 0x7f99d41e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.590+0000 7f99d922c640 1 -- 172.21.15.46:0/2947908011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009a70 con 0x7f99d40cc2c0 2024-01-27T14:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.592+0000 7f99d922c640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c400 tx=0x7f99d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.596+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0005ce0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.596+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d0005e40 con 0x7f99d40cc2c0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.596+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d41e4440 con 0x7f99d40cc2c0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.596+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00072f0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.596+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d41e49c0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.597+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40742e0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.615+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f99d0007510 con 0x7f99d40cc2c0 2024-01-27T14:59:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.615+0000 7f99c5ffb640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 0x7f99b806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:51.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.616+0000 7f99d8a2b640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 0x7f99b806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:51.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.616+0000 7f99d8a2b640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 0x7f99b806d3e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99d40725d0 tx=0x7f99c8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.619+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f99d0057cb0 con 0x7f99d40cc2c0 2024-01-27T14:59:51.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:51.876+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f99d0053ff0 con 0x7f99d40cc2c0 2024-01-27T14:59:52.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.061+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d414fd70 con 0x7f99b806af20 2024-01-27T14:59:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.061+0000 7f99c5ffb640 1 -- 172.21.15.46:0/2947908011 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99d414fd70 con 0x7f99b806af20 2024-01-27T14:59:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-01-27T14:59:52.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 msgr2=0x7f99b806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 0x7f99b806d3e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99d40725d0 tx=0x7f99c8009190 comp rx=0 tx=0).stop 2024-01-27T14:59:52.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 msgr2=0x7f99d41f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c400 tx=0x7f99d000c8c0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 shutdown_connections 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f99b806af20 0x7f99b806d3e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99d415a3c0 0x7f99d41e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99d4153a20 0x7f99d40cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 --2- 172.21.15.46:0/2947908011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99d40cc2c0 0x7f99d41f0010 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 >> 172.21.15.46:0/2947908011 conn(0x7f99d4071fd0 msgr2=0x7f99d4151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 shutdown_connections 2024-01-27T14:59:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.063+0000 7f99db490640 1 -- 172.21.15.46:0/2947908011 wait complete. 2024-01-27T14:59:52.077 INFO:tasks.ceph:Scrubbing osd.4 2024-01-27T14:59:52.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.182+0000 7f66d465d640 1 Processor -- start 2024-01-27T14:59:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.182+0000 7f66d465d640 1 -- start start 2024-01-27T14:59:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d465d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66cc15b7c0 0x7f66cc0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d465d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66cc157590 0x7f66cc070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d465d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc15ad20 con 0x7f66cc151740 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d465d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0c73f0 con 0x7f66cc15b7c0 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d465d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0c86c0 con 0x7f66cc157590 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.183+0000 7f66d1bf8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66cc15b7c0 0x7f66cc0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.184+0000 7f66d1bf8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66cc15b7c0 0x7f66cc0c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33892/0 (socket says 172.21.15.46:33892) 2024-01-27T14:59:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.184+0000 7f66d1bf8640 1 -- 172.21.15.46:0/102379832 learned_addr learned my addr 172.21.15.46:0/102379832 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.186+0000 7f66d1bf8640 1 -- 172.21.15.46:0/102379832 >> v2:172.21.15.73:3300/0 conn(0x7f66cc157590 msgr2=0x7f66cc070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.186+0000 7f66d1bf8640 1 --2- 172.21.15.46:0/102379832 >> v2:172.21.15.73:3300/0 conn(0x7f66cc157590 0x7f66cc070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.186+0000 7f66d1bf8640 1 -- 172.21.15.46:0/102379832 >> v1:172.21.15.73:6789/0 conn(0x7f66cc151740 legacy=0x7f66cc0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.186+0000 7f66d1bf8640 1 -- 172.21.15.46:0/102379832 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0c8100 con 0x7f66cc15b7c0 2024-01-27T14:59:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.188+0000 7f66d1bf8640 1 --2- 172.21.15.46:0/102379832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc15b7c0 0x7f66cc0c9380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0c45a0 tx=0x7f66bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d2e793c77b26f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.191+0000 7f66d13f7640 1 -- 172.21.15.46:0/102379832 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc031870 con 0x7f66cc15b7c0 2024-01-27T14:59:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.191+0000 7f66d13f7640 1 -- 172.21.15.46:0/102379832 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc0319d0 con 0x7f66cc15b7c0 2024-01-27T14:59:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.191+0000 7f66d13f7640 1 -- 172.21.15.46:0/102379832 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc031d60 con 0x7f66cc15b7c0 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 -- 172.21.15.46:0/102379832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc15b7c0 msgr2=0x7f66cc0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 --2- 172.21.15.46:0/102379832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc15b7c0 0x7f66cc0c9380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0c45a0 tx=0x7f66bc02b910 comp rx=0 tx=0).stop 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 -- 172.21.15.46:0/102379832 shutdown_connections 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 --2- 172.21.15.46:0/102379832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc15b7c0 0x7f66cc0c9380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 --2- 172.21.15.46:0/102379832 >> v2:172.21.15.73:3300/0 conn(0x7f66cc157590 0x7f66cc070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 -- 172.21.15.46:0/102379832 >> 172.21.15.46:0/102379832 conn(0x7f66cc066ac0 msgr2=0x7f66cc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 -- 172.21.15.46:0/102379832 shutdown_connections 2024-01-27T14:59:52.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.192+0000 7f66d465d640 1 -- 172.21.15.46:0/102379832 wait complete. 2024-01-27T14:59:52.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.193+0000 7f66d465d640 1 Processor -- start 2024-01-27T14:59:52.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.193+0000 7f66d465d640 1 -- start start 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 0x7f66cc14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66cc157590 0x7f66cc0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66cc15b7c0 0x7f66cc14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0cc790 con 0x7f66cc151740 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc14fe40 con 0x7f66cc157590 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d465d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0cac70 con 0x7f66cc15b7c0 2024-01-27T14:59:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.194+0000 7f66d23f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 0x7f66cc14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.195+0000 7f66d23f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 0x7f66cc14ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33906/0 (socket says 172.21.15.46:33906) 2024-01-27T14:59:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.195+0000 7f66d23f9640 1 -- 172.21.15.46:0/3078251884 learned_addr learned my addr 172.21.15.46:0/3078251884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d23f9640 1 -- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66cc15b7c0 msgr2=0x7f66cc14c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d23f9640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66cc15b7c0 0x7f66cc14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d23f9640 1 -- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66cc157590 msgr2=0x7f66cc0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d1bf8640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66cc157590 0x7f66cc0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d23f9640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66cc157590 0x7f66cc0cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.198+0000 7f66d23f9640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc0094d0 con 0x7f66cc151740 2024-01-27T14:59:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.200+0000 7f66d23f9640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 0x7f66cc14ed40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66c800ba50 tx=0x7f66c800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.206+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800cc10 con 0x7f66cc151740 2024-01-27T14:59:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.206+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800cd70 con 0x7f66cc151740 2024-01-27T14:59:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.206+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8014680 con 0x7f66cc151740 2024-01-27T14:59:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.206+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc0cca00 con 0x7f66cc151740 2024-01-27T14:59:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.207+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc150330 con 0x7f66cc151740 2024-01-27T14:59:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.207+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66cc15b2a0 con 0x7f66cc151740 2024-01-27T14:59:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.227+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f66c801d3b0 con 0x7f66cc151740 2024-01-27T14:59:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.227+0000 7f66c2ffd640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f66b006aed0 0x7f66b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.228+0000 7f66d1bf8640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f66b006aed0 0x7f66b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.228+0000 7f66d1bf8640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f66b006aed0 0x7f66b006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66bc036000 tx=0x7f66bc03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.232+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f66c8059040 con 0x7f66cc151740 2024-01-27T14:59:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.232+0000 7f66c2ffd640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f66b00745b0 0x7f66b0076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.232+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66b0077120 con 0x7f66b00745b0 2024-01-27T14:59:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.232+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c8054c80 con 0x7f66cc151740 2024-01-27T14:59:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.232+0000 7f66d2bfa640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f66b00745b0 0x7f66b0076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.233+0000 7f66d2bfa640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f66b00745b0 0x7f66b0076a50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.233+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== osd.4 v2:172.21.15.73:6808/348968633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f66b0077120 con 0x7f66b00745b0 2024-01-27T14:59:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.247+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 --> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66cc15afc0 con 0x7f66b00745b0 2024-01-27T14:59:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.247+0000 7f66c2ffd640 1 -- 172.21.15.46:0/3078251884 <== osd.4 v2:172.21.15.73:6808/348968633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f66c40097f0 con 0x7f66b00745b0 2024-01-27T14:59:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:52.249 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:52.250 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.247+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f66b00745b0 msgr2=0x7f66b0076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.247+0000 7f66d465d640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.73:6808/348968633,v1:172.21.15.73:6809/348968633] conn(0x7f66b00745b0 0x7f66b0076a50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f66b006aed0 msgr2=0x7f66b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f66b006aed0 0x7f66b006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66bc036000 tx=0x7f66bc03c040 comp rx=0 tx=0).stop 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 msgr2=0x7f66cc14ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 --2- 172.21.15.46:0/3078251884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66cc151740 0x7f66cc14ed40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66c800ba50 tx=0x7f66c800bf10 comp rx=0 tx=0).stop 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d2bfa640 1 -- 172.21.15.46:0/3078251884 reap_dead start 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 shutdown_connections 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 >> 172.21.15.46:0/3078251884 conn(0x7f66cc066ac0 msgr2=0x7f66cc070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 shutdown_connections 2024-01-27T14:59:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.248+0000 7f66d465d640 1 -- 172.21.15.46:0/3078251884 wait complete. 2024-01-27T14:59:52.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-27T14:59:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.360+0000 7fcd23e3d640 1 Processor -- start 2024-01-27T14:59:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 -- start start 2024-01-27T14:59:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 0x7fcd1c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c15b9b0 con 0x7fcd1c15b520 2024-01-27T14:59:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c158500 con 0x7fcd1c151810 2024-01-27T14:59:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.361+0000 7fcd23e3d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c15aad0 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.362+0000 7fcd213d8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.362+0000 7fcd21bd9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 0x7fcd1c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.362+0000 7fcd21bd9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 0x7fcd1c0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40304/0 (socket says 172.21.15.46:40304) 2024-01-27T14:59:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.362+0000 7fcd21bd9640 1 -- 172.21.15.46:0/278457870 learned_addr learned my addr 172.21.15.46:0/278457870 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.362+0000 7fcd213d8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:53546/0 (socket says 172.21.15.46:53546) 2024-01-27T14:59:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.365+0000 7fcd213d8640 1 -- 172.21.15.46:0/278457870 >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 msgr2=0x7fcd1c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.365+0000 7fcd213d8640 1 --2- 172.21.15.46:0/278457870 >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 0x7fcd1c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.365+0000 7fcd213d8640 1 -- 172.21.15.46:0/278457870 >> v1:172.21.15.73:6789/0 conn(0x7fcd1c15b520 legacy=0x7fcd1c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.365+0000 7fcd213d8640 1 -- 172.21.15.46:0/278457870 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c15b090 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.367+0000 7fcd213d8640 1 --2- 172.21.15.46:0/278457870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097a0 tx=0x7fcd1002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2af13f5bdd6722e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd20bd7640 1 -- 172.21.15.46:0/278457870 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10031830 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd20bd7640 1 -- 172.21.15.46:0/278457870 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10031990 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd20bd7640 1 -- 172.21.15.46:0/278457870 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10031d20 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 -- 172.21.15.46:0/278457870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 msgr2=0x7fcd1c0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/278457870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097a0 tx=0x7fcd1002b8d0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 -- 172.21.15.46:0/278457870 shutdown_connections 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/278457870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c0ca3d0 0x7fcd1c0c9380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/278457870 >> v2:172.21.15.73:3300/0 conn(0x7fcd1c151810 0x7fcd1c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.371+0000 7fcd23e3d640 1 -- 172.21.15.46:0/278457870 >> 172.21.15.46:0/278457870 conn(0x7fcd1c066c80 msgr2=0x7fcd1c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.372+0000 7fcd23e3d640 1 -- 172.21.15.46:0/278457870 shutdown_connections 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.372+0000 7fcd23e3d640 1 -- 172.21.15.46:0/278457870 wait complete. 2024-01-27T14:59:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 Processor -- start 2024-01-27T14:59:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 -- start start 2024-01-27T14:59:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 0x7fcd1c1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd1c151810 0x7fcd1c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 0x7fcd1c1ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1575a0 con 0x7fcd1c0ca3d0 2024-01-27T14:59:52.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e0c80 con 0x7fcd1c151810 2024-01-27T14:59:52.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.373+0000 7fcd23e3d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e0f60 con 0x7fcd1c15b520 2024-01-27T14:59:52.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.374+0000 7fcd21bd9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 0x7fcd1c1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.374+0000 7fcd213d8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd1c151810 0x7fcd1c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.374+0000 7fcd223da640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 0x7fcd1c1ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.374+0000 7fcd21bd9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 0x7fcd1c1f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33922/0 (socket says 172.21.15.46:33922) 2024-01-27T14:59:52.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.374+0000 7fcd21bd9640 1 -- 172.21.15.46:0/49476854 learned_addr learned my addr 172.21.15.46:0/49476854 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.378+0000 7fcd223da640 1 -- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd1c151810 msgr2=0x7fcd1c152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.378+0000 7fcd223da640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd1c151810 0x7fcd1c152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.378+0000 7fcd223da640 1 -- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 msgr2=0x7fcd1c1f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.378+0000 7fcd223da640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 0x7fcd1c1f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.378+0000 7fcd223da640 1 -- 172.21.15.46:0/49476854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009400 con 0x7fcd1c15b520 2024-01-27T14:59:52.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.380+0000 7fcd223da640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 0x7fcd1c1ed930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00be00 tx=0x7fcd0c00bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.384+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ce70 con 0x7fcd1c15b520 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.384+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c003970 con 0x7fcd1c15b520 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.384+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c003d60 con 0x7fcd1c15b520 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.384+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c1e1240 con 0x7fcd1c15b520 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.384+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c1ed410 con 0x7fcd1c15b520 2024-01-27T14:59:52.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.385+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c1ed600 con 0x7fcd1c15b520 2024-01-27T14:59:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.628+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcd0c003ec0 con 0x7fcd1c15b520 2024-01-27T14:59:52.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.629+0000 7fcd1a7fc640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 0x7fcd0806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.629+0000 7fcd21bd9640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 0x7fcd0806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.629+0000 7fcd21bd9640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 0x7fcd0806d3e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcd140094a0 tx=0x7fcd14009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.632+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fcd0c058aa0 con 0x7fcd1c15b520 2024-01-27T14:59:52.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.642+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcd0c054de0 con 0x7fcd1c15b520 2024-01-27T14:59:52.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.844+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd1c158220 con 0x7fcd0806af20 2024-01-27T14:59:52.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.845+0000 7fcd1a7fc640 1 -- 172.21.15.46:0/49476854 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd14009960 con 0x7fcd0806af20 2024-01-27T14:59:52.847 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-01-27T14:59:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 msgr2=0x7fcd0806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 0x7fcd0806d3e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcd140094a0 tx=0x7fcd14009240 comp rx=0 tx=0).stop 2024-01-27T14:59:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 msgr2=0x7fcd1c1ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 0x7fcd1c1ed930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00be00 tx=0x7fcd0c00bef0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 shutdown_connections 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fcd0806af20 0x7fcd0806d3e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd1c151810 0x7fcd1c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcd1c15b520 0x7fcd1c1ed930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 --2- 172.21.15.46:0/49476854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd1c0ca3d0 0x7fcd1c1f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 >> 172.21.15.46:0/49476854 conn(0x7fcd1c066c80 msgr2=0x7fcd1c0c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 shutdown_connections 2024-01-27T14:59:52.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.847+0000 7fcd23e3d640 1 -- 172.21.15.46:0/49476854 wait complete. 2024-01-27T14:59:52.860 INFO:tasks.ceph:Scrubbing osd.5 2024-01-27T14:59:52.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 Processor -- start 2024-01-27T14:59:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 -- start start 2024-01-27T14:59:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5f8153b90 0x7fc5f80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f80caa20 con 0x7fc5f808bf30 2024-01-27T14:59:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f80c5e70 con 0x7fc5f8153b90 2024-01-27T14:59:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.968+0000 7fc5fdac3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8153f70 con 0x7fc5f815d820 2024-01-27T14:59:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.969+0000 7fc5f77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5f8153b90 0x7fc5f80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.969+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.969+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:53564/0 (socket says 172.21.15.46:53564) 2024-01-27T14:59:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.969+0000 7fc5f7fff640 1 -- 172.21.15.46:0/389830211 learned_addr learned my addr 172.21.15.46:0/389830211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.972+0000 7fc5f7fff640 1 -- 172.21.15.46:0/389830211 >> v2:172.21.15.46:3300/0 conn(0x7fc5f8153b90 msgr2=0x7fc5f80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:52.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.972+0000 7fc5f7fff640 1 --2- 172.21.15.46:0/389830211 >> v2:172.21.15.46:3300/0 conn(0x7fc5f8153b90 0x7fc5f80cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.972+0000 7fc5f7fff640 1 -- 172.21.15.46:0/389830211 >> v1:172.21.15.46:6789/0 conn(0x7fc5f808bf30 legacy=0x7fc5f815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.972+0000 7fc5f7fff640 1 -- 172.21.15.46:0/389830211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8159960 con 0x7fc5f815d820 2024-01-27T14:59:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.974+0000 7fc5f7fff640 1 --2- 172.21.15.46:0/389830211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e50 tx=0x7fc5f002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f31b27fc2b534e58 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.977+0000 7fc5f67fc640 1 -- 172.21.15.46:0/389830211 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f002cb90 con 0x7fc5f815d820 2024-01-27T14:59:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.977+0000 7fc5f67fc640 1 -- 172.21.15.46:0/389830211 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f002ccf0 con 0x7fc5f815d820 2024-01-27T14:59:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.977+0000 7fc5f67fc640 1 -- 172.21.15.46:0/389830211 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0034610 con 0x7fc5f815d820 2024-01-27T14:59:52.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 -- 172.21.15.46:0/389830211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 msgr2=0x7fc5f80cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/389830211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e50 tx=0x7fc5f002bff0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 -- 172.21.15.46:0/389830211 shutdown_connections 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/389830211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f815d820 0x7fc5f80cfa60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/389830211 >> v2:172.21.15.46:3300/0 conn(0x7fc5f8153b90 0x7fc5f80cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 -- 172.21.15.46:0/389830211 >> 172.21.15.46:0/389830211 conn(0x7fc5f8066ac0 msgr2=0x7fc5f806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 -- 172.21.15.46:0/389830211 shutdown_connections 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.978+0000 7fc5fdac3640 1 -- 172.21.15.46:0/389830211 wait complete. 2024-01-27T14:59:52.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.979+0000 7fc5fdac3640 1 Processor -- start 2024-01-27T14:59:52.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.979+0000 7fc5fdac3640 1 -- start start 2024-01-27T14:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5f808bf30 0x7fc5f815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f8153b90 0x7fc5f80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 0x7fc5f80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815bcd0 con 0x7fc5f815d820 2024-01-27T14:59:52.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81f0130 con 0x7fc5f808bf30 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5fdac3640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80cc310 con 0x7fc5f8153b90 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 0x7fc5f80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5f6ffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f8153b90 0x7fc5f80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.980+0000 7fc5f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5f808bf30 0x7fc5f815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.981+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 0x7fc5f80cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33932/0 (socket says 172.21.15.46:33932) 2024-01-27T14:59:52.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.981+0000 7fc5f7fff640 1 -- 172.21.15.46:0/2677054511 learned_addr learned my addr 172.21.15.46:0/2677054511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f7fff640 1 -- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f8153b90 msgr2=0x7fc5f80b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f7fff640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f8153b90 0x7fc5f80b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f7fff640 1 -- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5f808bf30 msgr2=0x7fc5f815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f7fff640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5f808bf30 0x7fc5f815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f7fff640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0009b30 con 0x7fc5f815d820 2024-01-27T14:59:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.984+0000 7fc5f6ffd640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc5f8153b90 0x7fc5f80b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:59:52.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.987+0000 7fc5f7fff640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 0x7fc5f80cabc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e50 tx=0x7fc5f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:52.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.990+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0040670 con 0x7fc5f815d820 2024-01-27T14:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.990+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00407d0 con 0x7fc5f815d820 2024-01-27T14:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.990+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f81f05c0 con 0x7fc5f815d820 2024-01-27T14:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.990+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0040b80 con 0x7fc5f815d820 2024-01-27T14:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.990+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f81ef800 con 0x7fc5f815d820 2024-01-27T14:59:52.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:52.991+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5f81536f0 con 0x7fc5f815d820 2024-01-27T14:59:53.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.011+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc5f0040ce0 con 0x7fc5f815d820 2024-01-27T14:59:53.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.012+0000 7fc5dffff640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc5e406af20 0x7fc5e406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.012+0000 7fc5f77fe640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc5e406af20 0x7fc5e406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.012+0000 7fc5f77fe640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc5e406af20 0x7fc5e406d3e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009b40 tx=0x7fc5e8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.015+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc5f007b6a0 con 0x7fc5f815d820 2024-01-27T14:59:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.015+0000 7fc5dffff640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7fc5e4074680 0x7fc5e4076b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.015+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5e40771f0 con 0x7fc5e4074680 2024-01-27T14:59:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.015+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5f00779e0 con 0x7fc5f815d820 2024-01-27T14:59:53.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.016+0000 7fc5f6ffd640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7fc5e4074680 0x7fc5e4076b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.016+0000 7fc5f6ffd640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7fc5e4074680 0x7fc5e4076b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.017+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== osd.5 v2:172.21.15.73:6816/276149811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5e40771f0 con 0x7fc5e4074680 2024-01-27T14:59:53.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.030+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 --> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5f814f600 con 0x7fc5e4074680 2024-01-27T14:59:53.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5dffff640 1 -- 172.21.15.46:0/2677054511 <== osd.5 v2:172.21.15.73:6816/276149811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5f814f600 con 0x7fc5e4074680 2024-01-27T14:59:53.033 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:53.033 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:53.033 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7fc5e4074680 msgr2=0x7fc5e4076b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.73:6816/276149811,v1:172.21.15.73:6817/276149811] conn(0x7fc5e4074680 0x7fc5e4076b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc5e406af20 msgr2=0x7fc5e406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fc5e406af20 0x7fc5e406d3e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009b40 tx=0x7fc5e8009190 comp rx=0 tx=0).stop 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 msgr2=0x7fc5f80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 --2- 172.21.15.46:0/2677054511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5f815d820 0x7fc5f80cabc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009e50 tx=0x7fc5f0004a40 comp rx=0 tx=0).stop 2024-01-27T14:59:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5f7fff640 1 -- 172.21.15.46:0/2677054511 reap_dead start 2024-01-27T14:59:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 shutdown_connections 2024-01-27T14:59:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 >> 172.21.15.46:0/2677054511 conn(0x7fc5f8066ac0 msgr2=0x7fc5f806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 shutdown_connections 2024-01-27T14:59:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.031+0000 7fc5fdac3640 1 -- 172.21.15.46:0/2677054511 wait complete. 2024-01-27T14:59:53.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.146+0000 7f7e365d8640 1 Processor -- start 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.146+0000 7f7e365d8640 1 -- start start 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e365d8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e300cc480 0x7f7e3008bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e365d8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e300c9be0 0x7f7e300cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e365d8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3015cea0 con 0x7f7e300cf520 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e365d8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3015d180 con 0x7f7e300c9be0 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e365d8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3015d460 con 0x7f7e300cc480 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e34b75640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e300c9be0 0x7f7e300cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.147+0000 7f7e2f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e300cc480 0x7f7e3008bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.148+0000 7f7e34b75640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e300c9be0 0x7f7e300cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33940/0 (socket says 172.21.15.46:33940) 2024-01-27T14:59:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.148+0000 7f7e34b75640 1 -- 172.21.15.46:0/2077003095 learned_addr learned my addr 172.21.15.46:0/2077003095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:53.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.150+0000 7f7e34b75640 1 -- 172.21.15.46:0/2077003095 >> v2:172.21.15.73:3300/0 conn(0x7f7e300cc480 msgr2=0x7f7e3008bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:53.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.150+0000 7f7e34b75640 1 --2- 172.21.15.46:0/2077003095 >> v2:172.21.15.73:3300/0 conn(0x7f7e300cc480 0x7f7e3008bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.150+0000 7f7e34b75640 1 -- 172.21.15.46:0/2077003095 >> v1:172.21.15.73:6789/0 conn(0x7f7e300cf520 legacy=0x7f7e300cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.150+0000 7f7e34b75640 1 -- 172.21.15.46:0/2077003095 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3015d740 con 0x7f7e300c9be0 2024-01-27T14:59:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.152+0000 7f7e34b75640 1 --2- 172.21.15.46:0/2077003095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300c9be0 0x7f7e300cb5d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e300cd080 tx=0x7f7e2802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2439c31a07c4572 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e2effd640 1 -- 172.21.15.46:0/2077003095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2802c9f0 con 0x7f7e300c9be0 2024-01-27T14:59:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e2effd640 1 -- 172.21.15.46:0/2077003095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2802cb50 con 0x7f7e300c9be0 2024-01-27T14:59:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e2effd640 1 -- 172.21.15.46:0/2077003095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280343f0 con 0x7f7e300c9be0 2024-01-27T14:59:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 -- 172.21.15.46:0/2077003095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300c9be0 msgr2=0x7f7e300cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 --2- 172.21.15.46:0/2077003095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300c9be0 0x7f7e300cb5d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e300cd080 tx=0x7f7e2802be50 comp rx=0 tx=0).stop 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 -- 172.21.15.46:0/2077003095 shutdown_connections 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 --2- 172.21.15.46:0/2077003095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300c9be0 0x7f7e300cb5d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 --2- 172.21.15.46:0/2077003095 >> v2:172.21.15.73:3300/0 conn(0x7f7e300cc480 0x7f7e3008bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 -- 172.21.15.46:0/2077003095 >> 172.21.15.46:0/2077003095 conn(0x7f7e30066ac0 msgr2=0x7f7e3006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 -- 172.21.15.46:0/2077003095 shutdown_connections 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.160+0000 7f7e365d8640 1 -- 172.21.15.46:0/2077003095 wait complete. 2024-01-27T14:59:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.162+0000 7f7e365d8640 1 Processor -- start 2024-01-27T14:59:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.162+0000 7f7e365d8640 1 -- start start 2024-01-27T14:59:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e300c9be0 0x7f7e301e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e300cf520 0x7f7e30149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3015a420 con 0x7f7e300cc480 2024-01-27T14:59:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300c8e60 con 0x7f7e300c9be0 2024-01-27T14:59:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e365d8640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e301e4450 con 0x7f7e300cf520 2024-01-27T14:59:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.163+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.164+0000 7f7e2ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e300c9be0 0x7f7e301e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.164+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33954/0 (socket says 172.21.15.46:33954) 2024-01-27T14:59:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.164+0000 7f7e2f7fe640 1 -- 172.21.15.46:0/1091606644 learned_addr learned my addr 172.21.15.46:0/1091606644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.164+0000 7f7e34b75640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e300cf520 0x7f7e30149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.167+0000 7f7e2f7fe640 1 -- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e300cf520 msgr2=0x7f7e30149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.167+0000 7f7e2f7fe640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e300cf520 0x7f7e30149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.167+0000 7f7e2f7fe640 1 -- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e300c9be0 msgr2=0x7f7e301e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.167+0000 7f7e2f7fe640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e300c9be0 0x7f7e301e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.167+0000 7f7e2f7fe640 1 -- 172.21.15.46:0/1091606644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009b30 con 0x7f7e300cc480 2024-01-27T14:59:53.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.169+0000 7f7e2f7fe640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000e900 tx=0x7f7e2000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.171+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20009660 con 0x7f7e300cc480 2024-01-27T14:59:53.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.171+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e301e4730 con 0x7f7e300cc480 2024-01-27T14:59:53.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.171+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e300c8af0 con 0x7f7e300cc480 2024-01-27T14:59:53.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.172+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e300c9010 con 0x7f7e300cc480 2024-01-27T14:59:53.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.174+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000ca00 con 0x7f7e300cc480 2024-01-27T14:59:53.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.174+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000cd70 con 0x7f7e300cc480 2024-01-27T14:59:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.441+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7e20026480 con 0x7f7e300cc480 2024-01-27T14:59:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.441+0000 7f7e2cff9640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.441+0000 7f7e2ffff640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.441+0000 7f7e2ffff640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 0x7f7e1006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e180016e0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.469+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7e20058a10 con 0x7f7e300cc480 2024-01-27T14:59:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.470+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7e20054d50 con 0x7f7e300cc480 2024-01-27T14:59:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.656+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e300cb0f0 con 0x7f7e1006aed0 2024-01-27T14:59:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.656+0000 7f7e2cff9640 1 -- 172.21.15.46:0/1091606644 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e300cb0f0 con 0x7f7e1006aed0 2024-01-27T14:59:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-01-27T14:59:53.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 msgr2=0x7f7e1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 0x7f7e1006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e180016e0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2024-01-27T14:59:53.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 msgr2=0x7f7e300b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000e900 tx=0x7f7e2000edc0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 shutdown_connections 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e300cf520 0x7f7e30149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e300cc480 0x7f7e300b37e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 --2- 172.21.15.46:0/1091606644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e300c9be0 0x7f7e301e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.658+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 >> 172.21.15.46:0/1091606644 conn(0x7f7e30066ac0 msgr2=0x7f7e30071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:53.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.659+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 shutdown_connections 2024-01-27T14:59:53.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.659+0000 7f7e365d8640 1 -- 172.21.15.46:0/1091606644 wait complete. 2024-01-27T14:59:53.672 INFO:tasks.ceph:Scrubbing osd.6 2024-01-27T14:59:53.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:53.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.776+0000 7f449b3d1640 1 Processor -- start 2024-01-27T14:59:53.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.776+0000 7f449b3d1640 1 -- start start 2024-01-27T14:59:53.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.777+0000 7f449b3d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f449415d820 0x7f44940cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.777+0000 7f449b3d1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940caa20 con 0x7f4494153b90 2024-01-27T14:59:53.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.777+0000 7f449b3d1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494153f70 con 0x7f449408bf30 2024-01-27T14:59:53.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.777+0000 7f449b3d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940c5e70 con 0x7f449415d820 2024-01-27T14:59:53.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.778+0000 7f449996e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f449415d820 0x7f44940cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.779+0000 7f449996e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f449415d820 0x7f44940cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33960/0 (socket says 172.21.15.46:33960) 2024-01-27T14:59:53.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.779+0000 7f449996e640 1 -- 172.21.15.46:0/4168967889 learned_addr learned my addr 172.21.15.46:0/4168967889 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:53.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.781+0000 7f449996e640 1 -- 172.21.15.46:0/4168967889 >> v1:172.21.15.73:6789/0 conn(0x7f449408bf30 legacy=0x7f449415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:53.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.781+0000 7f449996e640 1 -- 172.21.15.46:0/4168967889 >> v1:172.21.15.46:6789/0 conn(0x7f4494153b90 legacy=0x7f44940cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.781+0000 7f449996e640 1 -- 172.21.15.46:0/4168967889 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494159960 con 0x7f449415d820 2024-01-27T14:59:53.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.784+0000 7f449996e640 1 --2- 172.21.15.46:0/4168967889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f449415d820 0x7f44940cc600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4494154100 tx=0x7f448c02bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5749db2608124b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f448bfff640 1 -- 172.21.15.46:0/4168967889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c02cb80 con 0x7f449415d820 2024-01-27T14:59:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f448bfff640 1 -- 172.21.15.46:0/4168967889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c02cce0 con 0x7f449415d820 2024-01-27T14:59:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f448bfff640 1 -- 172.21.15.46:0/4168967889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c034610 con 0x7f449415d820 2024-01-27T14:59:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 -- 172.21.15.46:0/4168967889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f449415d820 msgr2=0x7f44940cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 --2- 172.21.15.46:0/4168967889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f449415d820 0x7f44940cc600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4494154100 tx=0x7f448c02bfe0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 -- 172.21.15.46:0/4168967889 shutdown_connections 2024-01-27T14:59:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 --2- 172.21.15.46:0/4168967889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f449415d820 0x7f44940cc600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 -- 172.21.15.46:0/4168967889 >> 172.21.15.46:0/4168967889 conn(0x7f4494066ac0 msgr2=0x7f449406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 -- 172.21.15.46:0/4168967889 shutdown_connections 2024-01-27T14:59:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.793+0000 7f449b3d1640 1 -- 172.21.15.46:0/4168967889 wait complete. 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.794+0000 7f449b3d1640 1 Processor -- start 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 -- start start 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 0x7f449415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4494153b90 0x7f4494158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449415d820 0x7f4494159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940cde00 con 0x7f4494153b90 2024-01-27T14:59:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941f0090 con 0x7f449415d820 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.795+0000 7f449b3d1640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940cd1c0 con 0x7f449408bf30 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.796+0000 7f449996e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449415d820 0x7f4494159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.796+0000 7f449916d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 0x7f449415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.796+0000 7f449916d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 0x7f449415c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:53592/0 (socket says 172.21.15.46:53592) 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.796+0000 7f449916d640 1 -- 172.21.15.46:0/1380514492 learned_addr learned my addr 172.21.15.46:0/1380514492 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.796+0000 7f449996e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449415d820 0x7f4494159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:40356/0 (socket says 172.21.15.46:40356) 2024-01-27T14:59:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.800+0000 7f449916d640 1 -- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449415d820 msgr2=0x7f4494159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.800+0000 7f449916d640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449415d820 0x7f4494159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.800+0000 7f449916d640 1 -- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4494153b90 msgr2=0x7f4494158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.800+0000 7f449916d640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4494153b90 0x7f4494158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.800+0000 7f449916d640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c009b30 con 0x7f449408bf30 2024-01-27T14:59:53.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.802+0000 7f449916d640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 0x7f449415c090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f449000c430 tx=0x7f449000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.807+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900052d0 con 0x7f449408bf30 2024-01-27T14:59:53.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.807+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490005450 con 0x7f449408bf30 2024-01-27T14:59:53.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.808+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490007260 con 0x7f449408bf30 2024-01-27T14:59:53.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.808+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940cd460 con 0x7f449408bf30 2024-01-27T14:59:53.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.808+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940cda20 con 0x7f449408bf30 2024-01-27T14:59:53.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.809+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f449415a200 con 0x7f449408bf30 2024-01-27T14:59:53.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.889+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f44900073c0 con 0x7f449408bf30 2024-01-27T14:59:53.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.890+0000 7f4489ffb640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f447806af20 0x7f447806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.890+0000 7f449896c640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f447806af20 0x7f447806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.890+0000 7f449896c640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f447806af20 0x7f447806d3e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f44940cec60 tx=0x7f4484007990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.894+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4490007670 con 0x7f449408bf30 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.894+0000 7f4489ffb640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f4478074600 0x7f4478076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.894+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4478077170 con 0x7f4478074600 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.894+0000 7f449996e640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f4478074600 0x7f4478076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.895+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4490053ff0 con 0x7f449408bf30 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.895+0000 7f449996e640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f4478074600 0x7f4478076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.896+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== osd.6 v2:172.21.15.73:6800/71356255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4478077170 con 0x7f4478074600 2024-01-27T14:59:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.909+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 --> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4494159f20 con 0x7f4478074600 2024-01-27T14:59:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f4489ffb640 1 -- 172.21.15.46:0/1380514492 <== osd.6 v2:172.21.15.73:6800/71356255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f448c03f410 con 0x7f4478074600 2024-01-27T14:59:53.912 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:53.912 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:53.912 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f4478074600 msgr2=0x7f4478076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:6800/71356255,v1:172.21.15.73:6801/71356255] conn(0x7f4478074600 0x7f4478076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f447806af20 msgr2=0x7f447806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f447806af20 0x7f447806d3e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f44940cec60 tx=0x7f4484007990 comp rx=0 tx=0).stop 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 msgr2=0x7f449415c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 --2- 172.21.15.46:0/1380514492 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f449408bf30 0x7f449415c090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f449000c430 tx=0x7f449000c8f0 comp rx=0 tx=0).stop 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449996e640 1 -- 172.21.15.46:0/1380514492 reap_dead start 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 shutdown_connections 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 >> 172.21.15.46:0/1380514492 conn(0x7f4494066ac0 msgr2=0x7f449406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:53.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 shutdown_connections 2024-01-27T14:59:53.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:53.910+0000 7f449b3d1640 1 -- 172.21.15.46:0/1380514492 wait complete. 2024-01-27T14:59:53.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-27T14:59:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.023+0000 7fcab725c640 1 Processor -- start 2024-01-27T14:59:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.023+0000 7fcab725c640 1 -- start start 2024-01-27T14:59:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab725c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcab0153c00 0x7fcab015a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab725c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcab00b25b0 0x7fcab00b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab725c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00c4f40 con 0x7fcab00c9950 2024-01-27T14:59:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab725c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab015a7a0 con 0x7fcab0153c00 2024-01-27T14:59:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab725c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab00b2f40 con 0x7fcab00b25b0 2024-01-27T14:59:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab4ff8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcab0153c00 0x7fcab015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.024+0000 7fcab57f9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcab00b25b0 0x7fcab00b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.025+0000 7fcab4ff8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcab0153c00 0x7fcab015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33968/0 (socket says 172.21.15.46:33968) 2024-01-27T14:59:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.025+0000 7fcab4ff8640 1 -- 172.21.15.46:0/2117140823 learned_addr learned my addr 172.21.15.46:0/2117140823 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.027+0000 7fcab4ff8640 1 -- 172.21.15.46:0/2117140823 >> v2:172.21.15.73:3300/0 conn(0x7fcab00b25b0 msgr2=0x7fcab00b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.027+0000 7fcab4ff8640 1 --2- 172.21.15.46:0/2117140823 >> v2:172.21.15.73:3300/0 conn(0x7fcab00b25b0 0x7fcab00b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.027+0000 7fcab4ff8640 1 -- 172.21.15.46:0/2117140823 >> v1:172.21.15.73:6789/0 conn(0x7fcab00c9950 legacy=0x7fcab00cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.027+0000 7fcab4ff8640 1 -- 172.21.15.46:0/2117140823 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00c4070 con 0x7fcab0153c00 2024-01-27T14:59:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.029+0000 7fcab4ff8640 1 --2- 172.21.15.46:0/2117140823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab015a260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcab01573d0 tx=0x7fcaa402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8d280cdc4f9d11 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.032+0000 7fcaaf7fe640 1 -- 172.21.15.46:0/2117140823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4030860 con 0x7fcab0153c00 2024-01-27T14:59:54.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.032+0000 7fcaaf7fe640 1 -- 172.21.15.46:0/2117140823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40309c0 con 0x7fcab0153c00 2024-01-27T14:59:54.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.032+0000 7fcaaf7fe640 1 -- 172.21.15.46:0/2117140823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4030d50 con 0x7fcab0153c00 2024-01-27T14:59:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 -- 172.21.15.46:0/2117140823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 msgr2=0x7fcab015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 --2- 172.21.15.46:0/2117140823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab015a260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcab01573d0 tx=0x7fcaa402b9a0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 -- 172.21.15.46:0/2117140823 shutdown_connections 2024-01-27T14:59:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 --2- 172.21.15.46:0/2117140823 >> v2:172.21.15.73:3300/0 conn(0x7fcab00b25b0 0x7fcab00b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 --2- 172.21.15.46:0/2117140823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab015a260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 -- 172.21.15.46:0/2117140823 >> 172.21.15.46:0/2117140823 conn(0x7fcab006cca0 msgr2=0x7fcab006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 -- 172.21.15.46:0/2117140823 shutdown_connections 2024-01-27T14:59:54.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.033+0000 7fcab725c640 1 -- 172.21.15.46:0/2117140823 wait complete. 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.034+0000 7fcab725c640 1 Processor -- start 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.034+0000 7fcab725c640 1 -- start start 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcab00b25b0 0x7fcab00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcab00c9950 0x7fcab0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c6560 con 0x7fcab0153c00 2024-01-27T14:59:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c6800 con 0x7fcab00c9950 2024-01-27T14:59:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.035+0000 7fcab725c640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0156050 con 0x7fcab00b25b0 2024-01-27T14:59:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.036+0000 7fcab57f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.036+0000 7fcab57f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33976/0 (socket says 172.21.15.46:33976) 2024-01-27T14:59:54.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.036+0000 7fcab57f9640 1 -- 172.21.15.46:0/2922924924 learned_addr learned my addr 172.21.15.46:0/2922924924 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.036+0000 7fcaaffff640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcab00c9950 0x7fcab0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.036+0000 7fcab4ff8640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcab00b25b0 0x7fcab00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.039+0000 7fcab57f9640 1 -- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcab00b25b0 msgr2=0x7fcab00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.039+0000 7fcab57f9640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcab00b25b0 0x7fcab00c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.039+0000 7fcab57f9640 1 -- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcab00c9950 msgr2=0x7fcab0154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.039+0000 7fcab57f9640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcab00c9950 0x7fcab0154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.039+0000 7fcab57f9640 1 -- 172.21.15.46:0/2922924924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40094d0 con 0x7fcab0153c00 2024-01-27T14:59:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.042+0000 7fcab57f9640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800efc0 tx=0x7fcaa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.045+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8009ba0 con 0x7fcab0153c00 2024-01-27T14:59:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.045+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800f040 con 0x7fcab0153c00 2024-01-27T14:59:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.045+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab0155d40 con 0x7fcab0153c00 2024-01-27T14:59:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.045+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80146c0 con 0x7fcab0153c00 2024-01-27T14:59:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.045+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab01565a0 con 0x7fcab0153c00 2024-01-27T14:59:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.046+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab00742e0 con 0x7fcab0153c00 2024-01-27T14:59:54.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.312+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcaa8014820 con 0x7fcab0153c00 2024-01-27T14:59:54.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.312+0000 7fcaad7fa640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 0x7fca9406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.312+0000 7fcab4ff8640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 0x7fca9406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.313+0000 7fcab4ff8640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 0x7fca9406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4036000 tx=0x7fcaa4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.326+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fcaa80593f0 con 0x7fcab0153c00 2024-01-27T14:59:54.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.326+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcaa8055730 con 0x7fcab0153c00 2024-01-27T14:59:54.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.517+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab00c48f0 con 0x7fca9406aed0 2024-01-27T14:59:54.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.517+0000 7fcaad7fa640 1 -- 172.21.15.46:0/2922924924 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcaa4030bb0 con 0x7fca9406aed0 2024-01-27T14:59:54.519 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 msgr2=0x7fca9406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 0x7fca9406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4036000 tx=0x7fcaa4008030 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 msgr2=0x7fcab0149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800efc0 tx=0x7fcaa800c490 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 shutdown_connections 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fca9406aed0 0x7fca9406d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcab00c9950 0x7fcab0154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcab0153c00 0x7fcab0149910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 --2- 172.21.15.46:0/2922924924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcab00b25b0 0x7fcab00c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.519+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 >> 172.21.15.46:0/2922924924 conn(0x7fcab006cca0 msgr2=0x7fcab006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.520+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 shutdown_connections 2024-01-27T14:59:54.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.520+0000 7fcab725c640 1 -- 172.21.15.46:0/2922924924 wait complete. 2024-01-27T14:59:54.533 INFO:tasks.ceph:Scrubbing osd.7 2024-01-27T14:59:54.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:59:54.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 Processor -- start 2024-01-27T14:59:54.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 -- start start 2024-01-27T14:59:54.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac4153c00 0x7fdac415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac40c9950 0x7fdac40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40c4f40 con 0x7fdac40cf880 2024-01-27T14:59:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac415a7a0 con 0x7fdac40c9950 2024-01-27T14:59:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.637+0000 7fdac8cfb640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40c4070 con 0x7fdac4153c00 2024-01-27T14:59:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.638+0000 7fdac259c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac4153c00 0x7fdac415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.638+0000 7fdac1d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac40c9950 0x7fdac40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.638+0000 7fdac2d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdac40cf880 0x7fdac40b25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42928/0 (socket says 172.21.15.46:42928) 2024-01-27T14:59:54.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.638+0000 7fdac2d9d640 1 -- 172.21.15.46:0/2688498341 learned_addr learned my addr 172.21.15.46:0/2688498341 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:59:54.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.641+0000 7fdac1d9b640 1 -- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac4153c00 msgr2=0x7fdac415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:54.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.641+0000 7fdac1d9b640 1 --2- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac4153c00 0x7fdac415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.641+0000 7fdac1d9b640 1 -- 172.21.15.46:0/2688498341 >> v1:172.21.15.46:6789/0 conn(0x7fdac40cf880 legacy=0x7fdac40b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.641+0000 7fdac1d9b640 1 -- 172.21.15.46:0/2688498341 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40c4330 con 0x7fdac40c9950 2024-01-27T14:59:54.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.643+0000 7fdac1d9b640 1 --2- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40c9950 0x7fdac40cf340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0097a0 tx=0x7fdaac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1dd72163e7c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac159a640 1 -- 172.21.15.46:0/2688498341 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac031830 con 0x7fdac40c9950 2024-01-27T14:59:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac159a640 1 -- 172.21.15.46:0/2688498341 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac031990 con 0x7fdac40c9950 2024-01-27T14:59:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac159a640 1 -- 172.21.15.46:0/2688498341 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac031d20 con 0x7fdac40c9950 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 -- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40c9950 msgr2=0x7fdac40cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40c9950 0x7fdac40cf340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0097a0 tx=0x7fdaac02b8d0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 -- 172.21.15.46:0/2688498341 shutdown_connections 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40c9950 0x7fdac40cf340 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/2688498341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac4153c00 0x7fdac415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 -- 172.21.15.46:0/2688498341 >> 172.21.15.46:0/2688498341 conn(0x7fdac406cca0 msgr2=0x7fdac406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.647+0000 7fdac8cfb640 1 -- 172.21.15.46:0/2688498341 shutdown_connections 2024-01-27T14:59:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.648+0000 7fdac8cfb640 1 -- 172.21.15.46:0/2688498341 wait complete. 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.649+0000 7fdac8cfb640 1 Processor -- start 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.649+0000 7fdac8cfb640 1 -- start start 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.649+0000 7fdac8cfb640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac40c9950 0x7fdac414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac8cfb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40cf880 0x7fdac40b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac8cfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac4153c00 0x7fdac41499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac8cfb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41f24e0 con 0x7fdac4153c00 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac8cfb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41f2740 con 0x7fdac40cf880 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac8cfb640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41f2a20 con 0x7fdac40c9950 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac4153c00 0x7fdac41499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40cf880 0x7fdac40b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac259c640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac40c9950 0x7fdac414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac4153c00 0x7fdac41499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44186/0 (socket says 172.21.15.46:44186) 2024-01-27T14:59:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.650+0000 7fdac2d9d640 1 -- 172.21.15.46:0/1799671791 learned_addr learned my addr 172.21.15.46:0/1799671791 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.654+0000 7fdac1d9b640 1 -- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac40c9950 msgr2=0x7fdac414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.654+0000 7fdac1d9b640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac40c9950 0x7fdac414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.654+0000 7fdac1d9b640 1 -- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac4153c00 msgr2=0x7fdac41499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.654+0000 7fdac1d9b640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdac4153c00 0x7fdac41499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.654+0000 7fdac1d9b640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009400 con 0x7fdac40cf880 2024-01-27T14:59:54.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.656+0000 7fdac1d9b640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40cf880 0x7fdac40b3810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdaac033000 tx=0x7fdaac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.660+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac03a8f0 con 0x7fdac40cf880 2024-01-27T14:59:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.660+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac03aa90 con 0x7fdac40cf880 2024-01-27T14:59:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.660+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac03ae40 con 0x7fdac40cf880 2024-01-27T14:59:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.660+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac41f2d00 con 0x7fdac40cf880 2024-01-27T14:59:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.660+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac41f32c0 con 0x7fdac40cf880 2024-01-27T14:59:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.661+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdac40c4bd0 con 0x7fdac40cf880 2024-01-27T14:59:54.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.680+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdaac04d450 con 0x7fdac40cf880 2024-01-27T14:59:54.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.681+0000 7fdabaffd640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdaa406af20 0x7fdaa406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.681+0000 7fdac259c640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdaa406af20 0x7fdaa406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.681+0000 7fdac259c640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdaa406af20 0x7fdaa406d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009b40 tx=0x7fdabc009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.683+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fdaac07a7d0 con 0x7fdac40cf880 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.684+0000 7fdabaffd640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fdaa4074600 0x7fdaa4076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.684+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaa4077170 con 0x7fdaa4074600 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.684+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaac076b10 con 0x7fdac40cf880 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.684+0000 7fdac2d9d640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fdaa4074600 0x7fdaa4076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.684+0000 7fdac2d9d640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fdaa4074600 0x7fdaa4076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.685+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== osd.7 v2:172.21.15.73:6824/944085099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdaa4077170 con 0x7fdaa4074600 2024-01-27T14:59:54.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.698+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 --> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdac40c48f0 con 0x7fdaa4074600 2024-01-27T14:59:54.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdabaffd640 1 -- 172.21.15.46:0/1799671791 <== osd.7 v2:172.21.15.73:6824/944085099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdab4001fc0 con 0x7fdaa4074600 2024-01-27T14:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fdaa4074600 msgr2=0x7fdaa4076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:6824/944085099,v1:172.21.15.73:6825/944085099] conn(0x7fdaa4074600 0x7fdaa4076aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdaa406af20 msgr2=0x7fdaa406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fdaa406af20 0x7fdaa406d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009b40 tx=0x7fdabc009190 comp rx=0 tx=0).stop 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40cf880 msgr2=0x7fdac40b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 --2- 172.21.15.46:0/1799671791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40cf880 0x7fdac40b3810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdaac033000 tx=0x7fdaac0046c0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac2d9d640 1 -- 172.21.15.46:0/1799671791 reap_dead start 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 shutdown_connections 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 >> 172.21.15.46:0/1799671791 conn(0x7fdac406cca0 msgr2=0x7fdac4152130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:54.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 shutdown_connections 2024-01-27T14:59:54.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.699+0000 7fdac8cfb640 1 -- 172.21.15.46:0/1799671791 wait complete. 2024-01-27T14:59:54.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-27T14:59:54.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.814+0000 7f5cfb423640 1 Processor -- start 2024-01-27T14:59:54.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.814+0000 7f5cfb423640 1 -- start start 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf40ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5cf40ca3d0 0x7f5cf40c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cf415b520 0x7f5cf4157500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf4158500 con 0x7f5cf40ca3d0 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf4157a40 con 0x7f5cf415b520 2024-01-27T14:59:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.815+0000 7f5cfb423640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415b9b0 con 0x7f5cf4151810 2024-01-27T14:59:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.819+0000 7f5cf99c0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cf415b520 0x7f5cf4157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.819+0000 7f5cf91bf640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf40ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.820+0000 7f5cf99c0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cf415b520 0x7f5cf4157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:36996/0 (socket says 172.21.15.46:36996) 2024-01-27T14:59:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.820+0000 7f5cf99c0640 1 -- 172.21.15.46:0/2586386639 learned_addr learned my addr 172.21.15.46:0/2586386639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.824+0000 7f5cf99c0640 1 -- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 msgr2=0x7f5cf40ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.824+0000 7f5cf99c0640 1 --2- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf40ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.824+0000 7f5cf99c0640 1 -- 172.21.15.46:0/2586386639 >> v2:172.21.15.46:3300/0 conn(0x7f5cf40ca3d0 msgr2=0x7f5cf40c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.824+0000 7f5cf99c0640 1 --2- 172.21.15.46:0/2586386639 >> v2:172.21.15.46:3300/0 conn(0x7f5cf40ca3d0 0x7f5cf40c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.824+0000 7f5cf99c0640 1 -- 172.21.15.46:0/2586386639 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf415aad0 con 0x7f5cf415b520 2024-01-27T14:59:54.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.827+0000 7f5cf99c0640 1 --2- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf4157500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40718e0 tx=0x7f5cec02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb903d11a6f4fcda server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.880+0000 7f5cebfff640 1 -- 172.21.15.46:0/2586386639 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec02cb00 con 0x7f5cf415b520 2024-01-27T14:59:54.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.880+0000 7f5cebfff640 1 -- 172.21.15.46:0/2586386639 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec02cc60 con 0x7f5cf415b520 2024-01-27T14:59:54.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.880+0000 7f5cebfff640 1 -- 172.21.15.46:0/2586386639 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0343f0 con 0x7f5cf415b520 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 -- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 msgr2=0x7f5cf4157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 --2- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf4157500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40718e0 tx=0x7f5cec02bf60 comp rx=0 tx=0).stop 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 -- 172.21.15.46:0/2586386639 shutdown_connections 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 --2- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf4157500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 --2- 172.21.15.46:0/2586386639 >> v2:172.21.15.46:3300/0 conn(0x7f5cf40ca3d0 0x7f5cf40c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 --2- 172.21.15.46:0/2586386639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf40ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 -- 172.21.15.46:0/2586386639 >> 172.21.15.46:0/2586386639 conn(0x7f5cf4066c80 msgr2=0x7f5cf406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 -- 172.21.15.46:0/2586386639 shutdown_connections 2024-01-27T14:59:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.881+0000 7f5cfb423640 1 -- 172.21.15.46:0/2586386639 wait complete. 2024-01-27T14:59:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.882+0000 7f5cfb423640 1 Processor -- start 2024-01-27T14:59:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.882+0000 7f5cfb423640 1 -- start start 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cf40ca3d0 0x7f5cf40cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf406bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4156f80 con 0x7f5cf40ca3d0 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf406d810 con 0x7f5cf415b520 2024-01-27T14:59:54.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.883+0000 7f5cfb423640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4155b50 con 0x7f5cf4151810 2024-01-27T14:59:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.885+0000 7f5cf89be640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.885+0000 7f5cf89be640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48870/0 (socket says 172.21.15.46:48870) 2024-01-27T14:59:54.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.885+0000 7f5cf89be640 1 -- 172.21.15.46:0/1369410632 learned_addr learned my addr 172.21.15.46:0/1369410632 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:54.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.888+0000 7f5cf99c0640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf406bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.889+0000 7f5cf89be640 1 -- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 msgr2=0x7f5cf406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.889+0000 7f5cf89be640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf406bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.889+0000 7f5cf89be640 1 -- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cf40ca3d0 msgr2=0x7f5cf40cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.889+0000 7f5cf89be640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cf40ca3d0 0x7f5cf40cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:54.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.889+0000 7f5cf89be640 1 -- 172.21.15.46:0/1369410632 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009b30 con 0x7f5cf4151810 2024-01-27T14:59:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.895+0000 7f5cf89be640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b450 tx=0x7f5ce400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.906+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4011890 con 0x7f5cf4151810 2024-01-27T14:59:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.906+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40119f0 con 0x7f5cf4151810 2024-01-27T14:59:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.906+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf4155e30 con 0x7f5cf4151810 2024-01-27T14:59:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.906+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4011da0 con 0x7f5cf4151810 2024-01-27T14:59:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.907+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf41563f0 con 0x7f5cf4151810 2024-01-27T14:59:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.908+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf40742e0 con 0x7f5cf4151810 2024-01-27T14:59:54.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.926+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5ce401a400 con 0x7f5cf4151810 2024-01-27T14:59:54.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.927+0000 7f5ce9ffb640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 0x7f5cd806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:54.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.927+0000 7f5cf91bf640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 0x7f5cd806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:54.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.927+0000 7f5cf91bf640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 0x7f5cd806d3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0006a90 tx=0x7f5cf0006a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:54.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:54.930+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5ce4025e50 con 0x7f5cf4151810 2024-01-27T14:59:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.163+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5ce4058850 con 0x7f5cf4151810 2024-01-27T14:59:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.350+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cf406b860 con 0x7f5cd806af20 2024-01-27T14:59:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.350+0000 7f5ce9ffb640 1 -- 172.21.15.46:0/1369410632 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cf406b860 con 0x7f5cd806af20 2024-01-27T14:59:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-01-27T14:59:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 msgr2=0x7f5cd806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 0x7f5cd806d3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0006a90 tx=0x7f5cf0006a20 comp rx=0 tx=0).stop 2024-01-27T14:59:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 msgr2=0x7f5cf406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b450 tx=0x7f5ce400b910 comp rx=0 tx=0).stop 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 shutdown_connections 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5cd806af20 0x7f5cd806d3e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf415b520 0x7f5cf406bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf4151810 0x7f5cf406b9d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 --2- 172.21.15.46:0/1369410632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cf40ca3d0 0x7f5cf40cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 >> 172.21.15.46:0/1369410632 conn(0x7f5cf4066c80 msgr2=0x7f5cf40c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 shutdown_connections 2024-01-27T14:59:55.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.352+0000 7f5cfb423640 1 -- 172.21.15.46:0/1369410632 wait complete. 2024-01-27T14:59:55.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:59:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.466+0000 7f7b04bb0640 1 Processor -- start 2024-01-27T14:59:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.466+0000 7f7b04bb0640 1 -- start start 2024-01-27T14:59:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7b04bb0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b000cf2c0 0x7f7b000ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7b04bb0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7b04bb0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b000b3280 con 0x7f7b00153b00 2024-01-27T14:59:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7b04bb0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0015a8a0 con 0x7f7b000cf2c0 2024-01-27T14:59:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7b04bb0640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000caa10 con 0x7f7b000ca600 2024-01-27T14:59:55.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7af7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b000cf2c0 0x7f7b000ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.467+0000 7f7afed9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.468+0000 7f7afed9d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48886/0 (socket says 172.21.15.46:48886) 2024-01-27T14:59:55.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.468+0000 7f7afed9d640 1 -- 172.21.15.46:0/687283688 learned_addr learned my addr 172.21.15.46:0/687283688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.470+0000 7f7afed9d640 1 -- 172.21.15.46:0/687283688 >> v2:172.21.15.73:3300/0 conn(0x7f7b000cf2c0 msgr2=0x7f7b000ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:59:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.470+0000 7f7afed9d640 1 --2- 172.21.15.46:0/687283688 >> v2:172.21.15.73:3300/0 conn(0x7f7b000cf2c0 0x7f7b000ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.470+0000 7f7afed9d640 1 -- 172.21.15.46:0/687283688 >> v1:172.21.15.73:6789/0 conn(0x7f7b00153b00 legacy=0x7f7b000cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.470+0000 7f7afed9d640 1 -- 172.21.15.46:0/687283688 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0015d0d0 con 0x7f7b000ca600 2024-01-27T14:59:55.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.472+0000 7f7afed9d640 1 --2- 172.21.15.46:0/687283688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e50 tx=0x7f7af802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ceafc5f9b3ed04 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:55.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7afdd9b640 1 -- 172.21.15.46:0/687283688 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af802cb90 con 0x7f7b000ca600 2024-01-27T14:59:55.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7afdd9b640 1 -- 172.21.15.46:0/687283688 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af802ccf0 con 0x7f7b000ca600 2024-01-27T14:59:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7afdd9b640 1 -- 172.21.15.46:0/687283688 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8034610 con 0x7f7b000ca600 2024-01-27T14:59:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 -- 172.21.15.46:0/687283688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 msgr2=0x7f7b000b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/687283688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e50 tx=0x7f7af802bff0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 -- 172.21.15.46:0/687283688 shutdown_connections 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/687283688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000ca600 0x7f7b000b3730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/687283688 >> v2:172.21.15.73:3300/0 conn(0x7f7b000cf2c0 0x7f7b000ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 -- 172.21.15.46:0/687283688 >> 172.21.15.46:0/687283688 conn(0x7f7b0008b190 msgr2=0x7f7b0008b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 -- 172.21.15.46:0/687283688 shutdown_connections 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.476+0000 7f7b04bb0640 1 -- 172.21.15.46:0/687283688 wait complete. 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 Processor -- start 2024-01-27T14:59:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 -- start start 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 0x7f7b001f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 0x7f7b000c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b00153b00 0x7f7b000c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c6870 con 0x7f7b00153b00 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001f34d0 con 0x7f7b000ca600 2024-01-27T14:59:55.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.478+0000 7f7b04bb0640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c5de0 con 0x7f7b000cf2c0 2024-01-27T14:59:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.479+0000 7f7af7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 0x7f7b000c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.479+0000 7f7afed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b00153b00 0x7f7b000c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.479+0000 7f7afe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 0x7f7b001f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.479+0000 7f7af7fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 0x7f7b000c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:48896/0 (socket says 172.21.15.46:48896) 2024-01-27T14:59:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.479+0000 7f7af7fff640 1 -- 172.21.15.46:0/3720738934 learned_addr learned my addr 172.21.15.46:0/3720738934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:59:55.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.483+0000 7f7afe59c640 1 -- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 msgr2=0x7f7b000c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.483+0000 7f7afe59c640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 0x7f7b000c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.483+0000 7f7afe59c640 1 -- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b00153b00 msgr2=0x7f7b000c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.483+0000 7f7afe59c640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b00153b00 0x7f7b000c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.483+0000 7f7afe59c640 1 -- 172.21.15.46:0/3720738934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009b30 con 0x7f7b000ca600 2024-01-27T14:59:55.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.485+0000 7f7afe59c640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 0x7f7b001f2f90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7af000c3c0 tx=0x7f7af000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.489+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00052d0 con 0x7f7b000ca600 2024-01-27T14:59:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.489+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af0005450 con 0x7f7b000ca600 2024-01-27T14:59:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.489+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0007260 con 0x7f7b000ca600 2024-01-27T14:59:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.489+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b000c95e0 con 0x7f7b000ca600 2024-01-27T14:59:55.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.489+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000c55c0 con 0x7f7b000ca600 2024-01-27T14:59:55.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.490+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b000742e0 con 0x7f7b000ca600 2024-01-27T14:59:55.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.728+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7af00073c0 con 0x7f7b000ca600 2024-01-27T14:59:55.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.729+0000 7f7af6ffd640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 0x7f7ae006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:59:55.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.729+0000 7f7af7fff640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 0x7f7ae006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:59:55.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.729+0000 7f7af7fff640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 0x7f7ae006d3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b001575e0 tx=0x7f7ae8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:59:55.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.732+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f7af0057cc0 con 0x7f7b000ca600 2024-01-27T14:59:55.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.741+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7af0054000 con 0x7f7b000ca600 2024-01-27T14:59:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.923+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b000ca290 con 0x7f7ae006af20 2024-01-27T14:59:55.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.932+0000 7f7af6ffd640 1 -- 172.21.15.46:0/3720738934 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367690 (secure 0 0 0) 0x7f7b000ca290 con 0x7f7ae006af20 2024-01-27T14:59:55.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:59:55.940 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 msgr2=0x7f7ae006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 0x7f7ae006d3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b001575e0 tx=0x7f7ae8009190 comp rx=0 tx=0).stop 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 msgr2=0x7f7b001f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 0x7f7b001f2f90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7af000c3c0 tx=0x7f7af000c880 comp rx=0 tx=0).stop 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 shutdown_connections 2024-01-27T14:59:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f7ae006af20 0x7f7ae006d3e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b00153b00 0x7f7b000c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b000cf2c0 0x7f7b000c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 --2- 172.21.15.46:0/3720738934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b000ca600 0x7f7b001f2f90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 >> 172.21.15.46:0/3720738934 conn(0x7f7b0008b190 msgr2=0x7f7b001590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 shutdown_connections 2024-01-27T14:59:55.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:59:55.936+0000 7f7b04bb0640 1 -- 172.21.15.46:0/3720738934 wait complete. 2024-01-27T14:59:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":877,"stamp":"2024-01-27T14:59:55.388343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15344,"ondisk_log_size":15344,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472000,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":389491,"kb_avail":754502720,"statfs":{"total":773094113280,"available":772610785280,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":398839345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1214,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002469"},"pg_stats":[{"pgid":"2.1f","version":"29'615","reported_seq":655,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.367623+0000","last_change":"2024-01-27T14:31:50.752296+0000","last_active":"2024-01-27T14:59:32.367623+0000","last_peered":"2024-01-27T14:59:32.367623+0000","last_clean":"2024-01-27T14:59:32.367623+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:32.367623+0000","last_undegraded":"2024-01-27T14:59:32.367623+0000","last_fullsized":"2024-01-27T14:59:32.367623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.658141+0000","last_change":"2024-01-27T14:31:51.992144+0000","last_active":"2024-01-27T14:59:53.658141+0000","last_peered":"2024-01-27T14:59:53.658141+0000","last_clean":"2024-01-27T14:59:53.658141+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T14:59:53.658141+0000","last_undegraded":"2024-01-27T14:59:53.658141+0000","last_fullsized":"2024-01-27T14:59:53.658141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.823203+0000","last_change":"2024-01-27T14:31:57.751957+0000","last_active":"2024-01-27T14:59:09.823203+0000","last_peered":"2024-01-27T14:59:09.823203+0000","last_clean":"2024-01-27T14:59:09.823203+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T14:59:09.823203+0000","last_undegraded":"2024-01-27T14:59:09.823203+0000","last_fullsized":"2024-01-27T14:59:09.823203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:01:28.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'728","reported_seq":771,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.658037+0000","last_change":"2024-01-27T14:31:50.750535+0000","last_active":"2024-01-27T14:59:53.658037+0000","last_peered":"2024-01-27T14:59:53.658037+0000","last_clean":"2024-01-27T14:59:53.658037+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T14:59:53.658037+0000","last_undegraded":"2024-01-27T14:59:53.658037+0000","last_fullsized":"2024-01-27T14:59:53.658037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050739+0000","last_change":"2024-01-27T14:31:51.994162+0000","last_active":"2024-01-27T14:59:39.050739+0000","last_peered":"2024-01-27T14:59:39.050739+0000","last_clean":"2024-01-27T14:59:39.050739+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:39.050739+0000","last_undegraded":"2024-01-27T14:59:39.050739+0000","last_fullsized":"2024-01-27T14:59:39.050739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.617401+0000","last_change":"2024-01-27T14:31:57.746228+0000","last_active":"2024-01-27T14:59:08.617401+0000","last_peered":"2024-01-27T14:59:08.617401+0000","last_clean":"2024-01-27T14:59:08.617401+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T14:59:08.617401+0000","last_undegraded":"2024-01-27T14:59:08.617401+0000","last_fullsized":"2024-01-27T14:59:08.617401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1351","reported_seq":1390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.362631+0000","last_change":"2024-01-27T14:31:50.746740+0000","last_active":"2024-01-27T14:59:29.362631+0000","last_peered":"2024-01-27T14:59:29.362631+0000","last_clean":"2024-01-27T14:59:29.362631+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:29.362631+0000","last_undegraded":"2024-01-27T14:59:29.362631+0000","last_fullsized":"2024-01-27T14:59:29.362631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":1351,"log_dups_size":0,"ondisk_log_size":1351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.062453+0000","last_change":"2024-01-27T14:31:52.005589+0000","last_active":"2024-01-27T14:59:39.062453+0000","last_peered":"2024-01-27T14:59:39.062453+0000","last_clean":"2024-01-27T14:59:39.062453+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:39.062453+0000","last_undegraded":"2024-01-27T14:59:39.062453+0000","last_fullsized":"2024-01-27T14:59:39.062453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.407347+0000","last_change":"2024-01-27T14:31:57.746423+0000","last_active":"2024-01-27T14:59:29.407347+0000","last_peered":"2024-01-27T14:59:29.407347+0000","last_clean":"2024-01-27T14:59:29.407347+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T14:59:29.407347+0000","last_undegraded":"2024-01-27T14:59:29.407347+0000","last_fullsized":"2024-01-27T14:59:29.407347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.514130+0000","last_change":"2024-01-27T14:59:51.514187+0000","last_active":"2024-01-27T14:59:51.514130+0000","last_peered":"2024-01-27T14:59:51.514130+0000","last_clean":"2024-01-27T14:59:51.514130+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:51.514130+0000","last_undegraded":"2024-01-27T14:59:51.514130+0000","last_fullsized":"2024-01-27T14:59:51.514130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.514059+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:51.256705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.038951+0000","last_change":"2024-01-27T14:31:52.007677+0000","last_active":"2024-01-27T14:59:39.038951+0000","last_peered":"2024-01-27T14:59:39.038951+0000","last_clean":"2024-01-27T14:59:39.038951+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T14:59:39.038951+0000","last_undegraded":"2024-01-27T14:59:39.038951+0000","last_fullsized":"2024-01-27T14:59:39.038951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:29.407322+0000","last_change":"2024-01-27T14:31:57.744895+0000","last_active":"2024-01-27T14:59:29.407322+0000","last_peered":"2024-01-27T14:59:29.407322+0000","last_clean":"2024-01-27T14:59:29.407322+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T14:59:29.407322+0000","last_undegraded":"2024-01-27T14:59:29.407322+0000","last_fullsized":"2024-01-27T14:59:29.407322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.104143+0000","last_change":"2024-01-27T14:59:54.104191+0000","last_active":"2024-01-27T14:59:54.104143+0000","last_peered":"2024-01-27T14:59:54.104143+0000","last_clean":"2024-01-27T14:59:54.104143+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:54.104143+0000","last_undegraded":"2024-01-27T14:59:54.104143+0000","last_fullsized":"2024-01-27T14:59:54.104143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.104043+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:24:13.209696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'583","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.342397+0000","last_change":"2024-01-27T14:31:50.749653+0000","last_active":"2024-01-27T14:59:28.342397+0000","last_peered":"2024-01-27T14:59:28.342397+0000","last_clean":"2024-01-27T14:59:28.342397+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T14:59:28.342397+0000","last_undegraded":"2024-01-27T14:59:28.342397+0000","last_fullsized":"2024-01-27T14:59:28.342397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826942+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:59:10.826942+0000","last_peered":"2024-01-27T14:59:10.826942+0000","last_clean":"2024-01-27T14:59:10.826942+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:59:10.826942+0000","last_undegraded":"2024-01-27T14:59:10.826942+0000","last_fullsized":"2024-01-27T14:59:10.826942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.046052+0000","last_change":"2024-01-27T14:31:52.008732+0000","last_active":"2024-01-27T14:59:39.046052+0000","last_peered":"2024-01-27T14:59:39.046052+0000","last_clean":"2024-01-27T14:59:39.046052+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T14:59:39.046052+0000","last_undegraded":"2024-01-27T14:59:39.046052+0000","last_fullsized":"2024-01-27T14:59:39.046052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:56.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:57:53.272579+0000","last_change":"2024-01-27T14:31:50.747783+0000","last_active":"2024-01-27T14:57:53.272579+0000","last_peered":"2024-01-27T14:57:53.272579+0000","last_clean":"2024-01-27T14:57:53.272579+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:57:53.272579+0000","last_undegraded":"2024-01-27T14:57:53.272579+0000","last_fullsized":"2024-01-27T14:57:53.272579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:13.690401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.975839+0000","last_change":"2024-01-27T14:31:57.754923+0000","last_active":"2024-01-27T14:59:10.975839+0000","last_peered":"2024-01-27T14:59:10.975839+0000","last_clean":"2024-01-27T14:59:10.975839+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T14:59:10.975839+0000","last_undegraded":"2024-01-27T14:59:10.975839+0000","last_fullsized":"2024-01-27T14:59:10.975839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.890610+0000","last_change":"2024-01-27T14:59:52.890644+0000","last_active":"2024-01-27T14:59:52.890610+0000","last_peered":"2024-01-27T14:59:52.890610+0000","last_clean":"2024-01-27T14:59:52.890610+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:52.890610+0000","last_undegraded":"2024-01-27T14:59:52.890610+0000","last_fullsized":"2024-01-27T14:59:52.890610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.890548+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:40:48.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.367144+0000","last_change":"2024-01-27T14:31:50.742521+0000","last_active":"2024-01-27T14:59:32.367144+0000","last_peered":"2024-01-27T14:59:32.367144+0000","last_clean":"2024-01-27T14:59:32.367144+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:32.367144+0000","last_undegraded":"2024-01-27T14:59:32.367144+0000","last_fullsized":"2024-01-27T14:59:32.367144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.071002+0000","last_change":"2024-01-27T14:31:57.738327+0000","last_active":"2024-01-27T14:59:08.071002+0000","last_peered":"2024-01-27T14:59:08.071002+0000","last_clean":"2024-01-27T14:59:08.071002+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T14:59:08.071002+0000","last_undegraded":"2024-01-27T14:59:08.071002+0000","last_fullsized":"2024-01-27T14:59:08.071002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:51:54.908628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022786+0000","last_change":"2024-01-27T14:31:52.000161+0000","last_active":"2024-01-27T14:59:39.022786+0000","last_peered":"2024-01-27T14:59:39.022786+0000","last_clean":"2024-01-27T14:59:39.022786+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T14:59:39.022786+0000","last_undegraded":"2024-01-27T14:59:39.022786+0000","last_fullsized":"2024-01-27T14:59:39.022786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'7","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.519182+0000","last_change":"2024-01-27T14:59:52.519205+0000","last_active":"2024-01-27T14:59:52.519182+0000","last_peered":"2024-01-27T14:59:52.519182+0000","last_clean":"2024-01-27T14:59:52.519182+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:52.519182+0000","last_undegraded":"2024-01-27T14:59:52.519182+0000","last_fullsized":"2024-01-27T14:59:52.519182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.519116+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:32:55.885458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.969244+0000","last_change":"2024-01-27T14:31:57.744470+0000","last_active":"2024-01-27T14:59:10.969244+0000","last_peered":"2024-01-27T14:59:10.969244+0000","last_clean":"2024-01-27T14:59:10.969244+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:10.969244+0000","last_undegraded":"2024-01-27T14:59:10.969244+0000","last_fullsized":"2024-01-27T14:59:10.969244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.156829+0000","last_change":"2024-01-27T14:31:52.008367+0000","last_active":"2024-01-27T14:59:39.156829+0000","last_peered":"2024-01-27T14:59:39.156829+0000","last_clean":"2024-01-27T14:59:39.156829+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T14:59:39.156829+0000","last_undegraded":"2024-01-27T14:59:39.156829+0000","last_fullsized":"2024-01-27T14:59:39.156829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'14","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.363269+0000","last_change":"2024-01-27T14:31:50.754241+0000","last_active":"2024-01-27T14:59:32.363269+0000","last_peered":"2024-01-27T14:59:32.363269+0000","last_clean":"2024-01-27T14:59:32.363269+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T14:59:32.363269+0000","last_undegraded":"2024-01-27T14:59:32.363269+0000","last_fullsized":"2024-01-27T14:59:32.363269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.861347+0000","last_change":"2024-01-27T14:31:57.747750+0000","last_active":"2024-01-27T14:59:10.861347+0000","last_peered":"2024-01-27T14:59:10.861347+0000","last_clean":"2024-01-27T14:59:10.861347+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T14:59:10.861347+0000","last_undegraded":"2024-01-27T14:59:10.861347+0000","last_fullsized":"2024-01-27T14:59:10.861347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157870+0000","last_change":"2024-01-27T14:31:52.007486+0000","last_active":"2024-01-27T14:59:39.157870+0000","last_peered":"2024-01-27T14:59:39.157870+0000","last_clean":"2024-01-27T14:59:39.157870+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T14:59:39.157870+0000","last_undegraded":"2024-01-27T14:59:39.157870+0000","last_fullsized":"2024-01-27T14:59:39.157870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'316","reported_seq":355,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.152140+0000","last_change":"2024-01-27T14:31:50.743122+0000","last_active":"2024-01-27T14:59:39.152140+0000","last_peered":"2024-01-27T14:59:39.152140+0000","last_clean":"2024-01-27T14:59:39.152140+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:39.152140+0000","last_undegraded":"2024-01-27T14:59:39.152140+0000","last_fullsized":"2024-01-27T14:59:39.152140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.797457+0000","last_change":"2024-01-27T14:31:57.747174+0000","last_active":"2024-01-27T14:59:10.797457+0000","last_peered":"2024-01-27T14:59:10.797457+0000","last_clean":"2024-01-27T14:59:10.797457+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T14:59:10.797457+0000","last_undegraded":"2024-01-27T14:59:10.797457+0000","last_fullsized":"2024-01-27T14:59:10.797457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.022193+0000","last_change":"2024-01-27T14:31:52.007550+0000","last_active":"2024-01-27T14:59:39.022193+0000","last_peered":"2024-01-27T14:59:39.022193+0000","last_clean":"2024-01-27T14:59:39.022193+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T14:59:39.022193+0000","last_undegraded":"2024-01-27T14:59:39.022193+0000","last_fullsized":"2024-01-27T14:59:39.022193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:11:24.190412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.341931+0000","last_change":"2024-01-27T14:31:50.752506+0000","last_active":"2024-01-27T14:59:28.341931+0000","last_peered":"2024-01-27T14:59:28.341931+0000","last_clean":"2024-01-27T14:59:28.341931+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T14:59:28.341931+0000","last_undegraded":"2024-01-27T14:59:28.341931+0000","last_fullsized":"2024-01-27T14:59:28.341931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.167503+0000","last_change":"2024-01-27T14:31:57.754268+0000","last_active":"2024-01-27T14:59:08.167503+0000","last_peered":"2024-01-27T14:59:08.167503+0000","last_clean":"2024-01-27T14:59:08.167503+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T14:59:08.167503+0000","last_undegraded":"2024-01-27T14:59:08.167503+0000","last_fullsized":"2024-01-27T14:59:08.167503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:56:42.607527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065328+0000","last_change":"2024-01-27T14:31:52.009943+0000","last_active":"2024-01-27T14:59:39.065328+0000","last_peered":"2024-01-27T14:59:39.065328+0000","last_clean":"2024-01-27T14:59:39.065328+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:39.065328+0000","last_undegraded":"2024-01-27T14:59:39.065328+0000","last_fullsized":"2024-01-27T14:59:39.065328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.316076+0000","last_change":"2024-01-27T14:31:50.746059+0000","last_active":"2024-01-27T14:59:28.316076+0000","last_peered":"2024-01-27T14:59:28.316076+0000","last_clean":"2024-01-27T14:59:28.316076+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:59:28.316076+0000","last_undegraded":"2024-01-27T14:59:28.316076+0000","last_fullsized":"2024-01-27T14:59:28.316076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.911629+0000","last_change":"2024-01-27T14:31:57.748838+0000","last_active":"2024-01-27T14:59:09.911629+0000","last_peered":"2024-01-27T14:59:09.911629+0000","last_clean":"2024-01-27T14:59:09.911629+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T14:59:09.911629+0000","last_undegraded":"2024-01-27T14:59:09.911629+0000","last_fullsized":"2024-01-27T14:59:09.911629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:46.097649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129221+0000","last_change":"2024-01-27T14:31:52.008284+0000","last_active":"2024-01-27T14:59:39.129221+0000","last_peered":"2024-01-27T14:59:39.129221+0000","last_clean":"2024-01-27T14:59:39.129221+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T14:59:39.129221+0000","last_undegraded":"2024-01-27T14:59:39.129221+0000","last_fullsized":"2024-01-27T14:59:39.129221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:30.372664+0000","last_change":"2024-01-27T14:31:50.753467+0000","last_active":"2024-01-27T14:59:30.372664+0000","last_peered":"2024-01-27T14:59:30.372664+0000","last_clean":"2024-01-27T14:59:30.372664+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T14:59:30.372664+0000","last_undegraded":"2024-01-27T14:59:30.372664+0000","last_fullsized":"2024-01-27T14:59:30.372664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.875622+0000","last_change":"2024-01-27T14:32:21.654208+0000","last_active":"2024-01-27T14:59:10.875622+0000","last_peered":"2024-01-27T14:59:10.875622+0000","last_clean":"2024-01-27T14:59:10.875622+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T14:59:10.875622+0000","last_undegraded":"2024-01-27T14:59:10.875622+0000","last_fullsized":"2024-01-27T14:59:10.875622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:30:43.148497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.658058+0000","last_change":"2024-01-27T14:31:52.008982+0000","last_active":"2024-01-27T14:59:53.658058+0000","last_peered":"2024-01-27T14:59:53.658058+0000","last_clean":"2024-01-27T14:59:53.658058+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T14:59:53.658058+0000","last_undegraded":"2024-01-27T14:59:53.658058+0000","last_fullsized":"2024-01-27T14:59:53.658058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'934","reported_seq":1898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:36.353045+0000","last_change":"2024-01-27T14:31:50.747524+0000","last_active":"2024-01-27T14:59:36.353045+0000","last_peered":"2024-01-27T14:59:36.353045+0000","last_clean":"2024-01-27T14:59:36.353045+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:36.353045+0000","last_undegraded":"2024-01-27T14:59:36.353045+0000","last_fullsized":"2024-01-27T14:59:36.353045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:06:31.310595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.790336+0000","last_change":"2024-01-27T14:31:57.753489+0000","last_active":"2024-01-27T14:59:09.790336+0000","last_peered":"2024-01-27T14:59:09.790336+0000","last_clean":"2024-01-27T14:59:09.790336+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T14:59:09.790336+0000","last_undegraded":"2024-01-27T14:59:09.790336+0000","last_fullsized":"2024-01-27T14:59:09.790336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:14.708936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021770+0000","last_change":"2024-01-27T14:31:52.005160+0000","last_active":"2024-01-27T14:59:39.021770+0000","last_peered":"2024-01-27T14:59:39.021770+0000","last_clean":"2024-01-27T14:59:39.021770+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:39.021770+0000","last_undegraded":"2024-01-27T14:59:39.021770+0000","last_fullsized":"2024-01-27T14:59:39.021770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:54:09.154605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'478","reported_seq":520,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:27.419916+0000","last_change":"2024-01-27T14:31:50.753139+0000","last_active":"2024-01-27T14:59:27.419916+0000","last_peered":"2024-01-27T14:59:27.419916+0000","last_clean":"2024-01-27T14:59:27.419916+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T14:59:27.419916+0000","last_undegraded":"2024-01-27T14:59:27.419916+0000","last_fullsized":"2024-01-27T14:59:27.419916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.958246+0000","last_change":"2024-01-27T14:31:57.746065+0000","last_active":"2024-01-27T14:59:10.958246+0000","last_peered":"2024-01-27T14:59:10.958246+0000","last_clean":"2024-01-27T14:59:10.958246+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T14:59:10.958246+0000","last_undegraded":"2024-01-27T14:59:10.958246+0000","last_fullsized":"2024-01-27T14:59:10.958246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.154714+0000","last_change":"2024-01-27T14:31:52.003083+0000","last_active":"2024-01-27T14:59:39.154714+0000","last_peered":"2024-01-27T14:59:39.154714+0000","last_clean":"2024-01-27T14:59:39.154714+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T14:59:39.154714+0000","last_undegraded":"2024-01-27T14:59:39.154714+0000","last_fullsized":"2024-01-27T14:59:39.154714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'12","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.360112+0000","last_change":"2024-01-27T14:31:50.750201+0000","last_active":"2024-01-27T14:59:32.360112+0000","last_peered":"2024-01-27T14:59:32.360112+0000","last_clean":"2024-01-27T14:59:32.360112+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T14:59:32.360112+0000","last_undegraded":"2024-01-27T14:59:32.360112+0000","last_fullsized":"2024-01-27T14:59:32.360112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.074075+0000","last_change":"2024-01-27T14:59:51.074105+0000","last_active":"2024-01-27T14:59:51.074075+0000","last_peered":"2024-01-27T14:59:51.074075+0000","last_clean":"2024-01-27T14:59:51.074075+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:59:51.074075+0000","last_undegraded":"2024-01-27T14:59:51.074075+0000","last_fullsized":"2024-01-27T14:59:51.074075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.074018+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:28:32.754624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.790227+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:59:10.790227+0000","last_peered":"2024-01-27T14:59:10.790227+0000","last_clean":"2024-01-27T14:59:10.790227+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:59:10.790227+0000","last_undegraded":"2024-01-27T14:59:10.790227+0000","last_fullsized":"2024-01-27T14:59:10.790227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.090252+0000","last_change":"2024-01-27T14:59:53.090272+0000","last_active":"2024-01-27T14:59:53.090252+0000","last_peered":"2024-01-27T14:59:53.090252+0000","last_clean":"2024-01-27T14:59:53.090252+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:53.090252+0000","last_undegraded":"2024-01-27T14:59:53.090252+0000","last_fullsized":"2024-01-27T14:59:53.090252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.090187+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:08:50.389343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.360055+0000","last_change":"2024-01-27T14:31:50.748748+0000","last_active":"2024-01-27T14:59:32.360055+0000","last_peered":"2024-01-27T14:59:32.360055+0000","last_clean":"2024-01-27T14:59:32.360055+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:32.360055+0000","last_undegraded":"2024-01-27T14:59:32.360055+0000","last_fullsized":"2024-01-27T14:59:32.360055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:19:44.960390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.927359+0000","last_change":"2024-01-27T14:31:57.744699+0000","last_active":"2024-01-27T14:59:10.927359+0000","last_peered":"2024-01-27T14:59:10.927359+0000","last_clean":"2024-01-27T14:59:10.927359+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T14:59:10.927359+0000","last_undegraded":"2024-01-27T14:59:10.927359+0000","last_fullsized":"2024-01-27T14:59:10.927359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.130540+0000","last_change":"2024-01-27T14:31:52.009146+0000","last_active":"2024-01-27T14:59:39.130540+0000","last_peered":"2024-01-27T14:59:39.130540+0000","last_clean":"2024-01-27T14:59:39.130540+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T14:59:39.130540+0000","last_undegraded":"2024-01-27T14:59:39.130540+0000","last_fullsized":"2024-01-27T14:59:39.130540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:30.376046+0000","last_change":"2024-01-27T14:31:50.749449+0000","last_active":"2024-01-27T14:59:30.376046+0000","last_peered":"2024-01-27T14:59:30.376046+0000","last_clean":"2024-01-27T14:59:30.376046+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:30.376046+0000","last_undegraded":"2024-01-27T14:59:30.376046+0000","last_fullsized":"2024-01-27T14:59:30.376046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":214,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.837718+0000","last_change":"2024-01-27T14:31:57.736966+0000","last_active":"2024-01-27T14:59:09.837718+0000","last_peered":"2024-01-27T14:59:09.837718+0000","last_clean":"2024-01-27T14:59:09.837718+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T14:59:09.837718+0000","last_undegraded":"2024-01-27T14:59:09.837718+0000","last_fullsized":"2024-01-27T14:59:09.837718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148735+0000","last_change":"2024-01-27T14:31:52.008498+0000","last_active":"2024-01-27T14:59:39.148735+0000","last_peered":"2024-01-27T14:59:39.148735+0000","last_clean":"2024-01-27T14:59:39.148735+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T14:59:39.148735+0000","last_undegraded":"2024-01-27T14:59:39.148735+0000","last_fullsized":"2024-01-27T14:59:39.148735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:22.083634+0000","last_change":"2024-01-27T14:31:50.747230+0000","last_active":"2024-01-27T14:59:22.083634+0000","last_peered":"2024-01-27T14:59:22.083634+0000","last_clean":"2024-01-27T14:59:22.083634+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:22.083634+0000","last_undegraded":"2024-01-27T14:59:22.083634+0000","last_fullsized":"2024-01-27T14:59:22.083634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.892436+0000","last_change":"2024-01-27T14:31:57.735699+0000","last_active":"2024-01-27T14:59:09.892436+0000","last_peered":"2024-01-27T14:59:09.892436+0000","last_clean":"2024-01-27T14:59:09.892436+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T14:59:09.892436+0000","last_undegraded":"2024-01-27T14:59:09.892436+0000","last_fullsized":"2024-01-27T14:59:09.892436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.067488+0000","last_change":"2024-01-27T14:31:52.010636+0000","last_active":"2024-01-27T14:59:39.067488+0000","last_peered":"2024-01-27T14:59:39.067488+0000","last_clean":"2024-01-27T14:59:39.067488+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:39.067488+0000","last_undegraded":"2024-01-27T14:59:39.067488+0000","last_fullsized":"2024-01-27T14:59:39.067488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.482452+0000","last_change":"2024-01-27T14:59:53.482502+0000","last_active":"2024-01-27T14:59:53.482452+0000","last_peered":"2024-01-27T14:59:53.482452+0000","last_clean":"2024-01-27T14:59:53.482452+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:53.482452+0000","last_undegraded":"2024-01-27T14:59:53.482452+0000","last_fullsized":"2024-01-27T14:59:53.482452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.482327+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:48.182635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:09.774806+0000","last_change":"2024-01-27T14:31:57.735704+0000","last_active":"2024-01-27T14:59:09.774806+0000","last_peered":"2024-01-27T14:59:09.774806+0000","last_clean":"2024-01-27T14:59:09.774806+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:09.774806+0000","last_undegraded":"2024-01-27T14:59:09.774806+0000","last_fullsized":"2024-01-27T14:59:09.774806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.062586+0000","last_change":"2024-01-27T14:31:51.993873+0000","last_active":"2024-01-27T14:59:52.062586+0000","last_peered":"2024-01-27T14:59:52.062586+0000","last_clean":"2024-01-27T14:59:52.062586+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:52.062586+0000","last_undegraded":"2024-01-27T14:59:52.062586+0000","last_fullsized":"2024-01-27T14:59:52.062586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'21","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.846321+0000","last_change":"2024-01-27T14:31:50.747669+0000","last_active":"2024-01-27T14:59:52.846321+0000","last_peered":"2024-01-27T14:59:52.846321+0000","last_clean":"2024-01-27T14:59:52.846321+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:52.846321+0000","last_undegraded":"2024-01-27T14:59:52.846321+0000","last_fullsized":"2024-01-27T14:59:52.846321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.860376+0000","last_change":"2024-01-27T14:31:57.744609+0000","last_active":"2024-01-27T14:59:10.860376+0000","last_peered":"2024-01-27T14:59:10.860376+0000","last_clean":"2024-01-27T14:59:10.860376+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T14:59:10.860376+0000","last_undegraded":"2024-01-27T14:59:10.860376+0000","last_fullsized":"2024-01-27T14:59:10.860376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.075077+0000","last_change":"2024-01-27T14:59:53.075077+0000","last_active":"2024-01-27T14:59:53.075077+0000","last_peered":"2024-01-27T14:59:53.075077+0000","last_clean":"2024-01-27T14:59:53.075077+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:53.075077+0000","last_undegraded":"2024-01-27T14:59:53.075077+0000","last_fullsized":"2024-01-27T14:59:53.075077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.074985+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:38:41.272079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:49.596032+0000","last_change":"2024-01-27T14:31:50.752262+0000","last_active":"2024-01-27T14:59:49.596032+0000","last_peered":"2024-01-27T14:59:49.596032+0000","last_clean":"2024-01-27T14:59:49.596032+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:49.596032+0000","last_undegraded":"2024-01-27T14:59:49.596032+0000","last_fullsized":"2024-01-27T14:59:49.596032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.923802+0000","last_change":"2024-01-27T14:31:57.746141+0000","last_active":"2024-01-27T14:59:10.923802+0000","last_peered":"2024-01-27T14:59:10.923802+0000","last_clean":"2024-01-27T14:59:10.923802+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T14:59:10.923802+0000","last_undegraded":"2024-01-27T14:59:10.923802+0000","last_fullsized":"2024-01-27T14:59:10.923802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.062402+0000","last_change":"2024-01-27T14:31:52.011535+0000","last_active":"2024-01-27T14:59:52.062402+0000","last_peered":"2024-01-27T14:59:52.062402+0000","last_clean":"2024-01-27T14:59:52.062402+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T14:59:52.062402+0000","last_undegraded":"2024-01-27T14:59:52.062402+0000","last_fullsized":"2024-01-27T14:59:52.062402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'13","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.062375+0000","last_change":"2024-01-27T14:31:50.752231+0000","last_active":"2024-01-27T14:59:52.062375+0000","last_peered":"2024-01-27T14:59:52.062375+0000","last_clean":"2024-01-27T14:59:52.062375+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T14:59:52.062375+0000","last_undegraded":"2024-01-27T14:59:52.062375+0000","last_fullsized":"2024-01-27T14:59:52.062375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.246924+0000","last_change":"2024-01-27T14:31:57.752234+0000","last_active":"2024-01-27T14:59:08.246924+0000","last_peered":"2024-01-27T14:59:08.246924+0000","last_clean":"2024-01-27T14:59:08.246924+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T14:59:08.246924+0000","last_undegraded":"2024-01-27T14:59:08.246924+0000","last_fullsized":"2024-01-27T14:59:08.246924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:31:19.577956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021966+0000","last_change":"2024-01-27T14:31:52.006119+0000","last_active":"2024-01-27T14:59:39.021966+0000","last_peered":"2024-01-27T14:59:39.021966+0000","last_clean":"2024-01-27T14:59:39.021966+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.021966+0000","last_undegraded":"2024-01-27T14:59:39.021966+0000","last_fullsized":"2024-01-27T14:59:39.021966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:12:51.748570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'260","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.314175+0000","last_change":"2024-01-27T14:31:50.751181+0000","last_active":"2024-01-27T14:59:39.314175+0000","last_peered":"2024-01-27T14:59:39.314175+0000","last_clean":"2024-01-27T14:59:39.314175+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:39.314175+0000","last_undegraded":"2024-01-27T14:59:39.314175+0000","last_fullsized":"2024-01-27T14:59:39.314175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:13:58.869413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.931926+0000","last_change":"2024-01-27T14:32:21.654217+0000","last_active":"2024-01-27T14:59:10.931926+0000","last_peered":"2024-01-27T14:59:10.931926+0000","last_clean":"2024-01-27T14:59:10.931926+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T14:59:10.931926+0000","last_undegraded":"2024-01-27T14:59:10.931926+0000","last_fullsized":"2024-01-27T14:59:10.931926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129314+0000","last_change":"2024-01-27T14:31:52.009748+0000","last_active":"2024-01-27T14:59:39.129314+0000","last_peered":"2024-01-27T14:59:39.129314+0000","last_clean":"2024-01-27T14:59:39.129314+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T14:59:39.129314+0000","last_undegraded":"2024-01-27T14:59:39.129314+0000","last_fullsized":"2024-01-27T14:59:39.129314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":882,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.841211+0000","last_change":"2024-01-27T14:59:51.841211+0000","last_active":"2024-01-27T14:59:51.841211+0000","last_peered":"2024-01-27T14:59:51.841211+0000","last_clean":"2024-01-27T14:59:51.841211+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:51.841211+0000","last_undegraded":"2024-01-27T14:59:51.841211+0000","last_fullsized":"2024-01-27T14:59:51.841211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'834","last_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_deep_scrub":"29'834","last_deep_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.841116+0000","objects_scrubbed":6,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:32.987727+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.797454+0000","last_change":"2024-01-27T14:31:57.750370+0000","last_active":"2024-01-27T14:59:10.797454+0000","last_peered":"2024-01-27T14:59:10.797454+0000","last_clean":"2024-01-27T14:59:10.797454+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T14:59:10.797454+0000","last_undegraded":"2024-01-27T14:59:10.797454+0000","last_fullsized":"2024-01-27T14:59:10.797454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.052018+0000","last_change":"2024-01-27T14:31:51.992656+0000","last_active":"2024-01-27T14:59:39.052018+0000","last_peered":"2024-01-27T14:59:39.052018+0000","last_clean":"2024-01-27T14:59:39.052018+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:39.052018+0000","last_undegraded":"2024-01-27T14:59:39.052018+0000","last_fullsized":"2024-01-27T14:59:39.052018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'629","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.377338+0000","last_change":"2024-01-27T14:31:50.752287+0000","last_active":"2024-01-27T14:59:32.377338+0000","last_peered":"2024-01-27T14:59:32.377338+0000","last_clean":"2024-01-27T14:59:32.377338+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:32.377338+0000","last_undegraded":"2024-01-27T14:59:32.377338+0000","last_fullsized":"2024-01-27T14:59:32.377338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:01:29.453195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826630+0000","last_change":"2024-01-27T14:31:57.744761+0000","last_active":"2024-01-27T14:59:10.826630+0000","last_peered":"2024-01-27T14:59:10.826630+0000","last_clean":"2024-01-27T14:59:10.826630+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T14:59:10.826630+0000","last_undegraded":"2024-01-27T14:59:10.826630+0000","last_fullsized":"2024-01-27T14:59:10.826630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.052439+0000","last_change":"2024-01-27T14:31:51.917238+0000","last_active":"2024-01-27T14:59:39.052439+0000","last_peered":"2024-01-27T14:59:39.052439+0000","last_clean":"2024-01-27T14:59:39.052439+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T14:59:39.052439+0000","last_undegraded":"2024-01-27T14:59:39.052439+0000","last_fullsized":"2024-01-27T14:59:39.052439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.367544+0000","last_change":"2024-01-27T14:31:50.747146+0000","last_active":"2024-01-27T14:59:32.367544+0000","last_peered":"2024-01-27T14:59:32.367544+0000","last_clean":"2024-01-27T14:59:32.367544+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:32.367544+0000","last_undegraded":"2024-01-27T14:59:32.367544+0000","last_fullsized":"2024-01-27T14:59:32.367544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:08.360645+0000","last_change":"2024-01-27T14:31:57.739777+0000","last_active":"2024-01-27T14:59:08.360645+0000","last_peered":"2024-01-27T14:59:08.360645+0000","last_clean":"2024-01-27T14:59:08.360645+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T14:59:08.360645+0000","last_undegraded":"2024-01-27T14:59:08.360645+0000","last_fullsized":"2024-01-27T14:59:08.360645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.578740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.817209+0000","last_change":"2024-01-27T14:59:52.817230+0000","last_active":"2024-01-27T14:59:52.817209+0000","last_peered":"2024-01-27T14:59:52.817209+0000","last_clean":"2024-01-27T14:59:52.817209+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:52.817209+0000","last_undegraded":"2024-01-27T14:59:52.817209+0000","last_fullsized":"2024-01-27T14:59:52.817209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.817143+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:28:29.310432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.031357+0000","last_change":"2024-01-27T14:59:52.031381+0000","last_active":"2024-01-27T14:59:52.031357+0000","last_peered":"2024-01-27T14:59:52.031357+0000","last_clean":"2024-01-27T14:59:52.031357+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:52.031357+0000","last_undegraded":"2024-01-27T14:59:52.031357+0000","last_fullsized":"2024-01-27T14:59:52.031357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.031300+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:12.849424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.948755+0000","last_change":"2024-01-27T14:31:57.749331+0000","last_active":"2024-01-27T14:59:10.948755+0000","last_peered":"2024-01-27T14:59:10.948755+0000","last_clean":"2024-01-27T14:59:10.948755+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T14:59:10.948755+0000","last_undegraded":"2024-01-27T14:59:10.948755+0000","last_fullsized":"2024-01-27T14:59:10.948755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.989716+0000","last_change":"2024-01-27T14:32:21.654246+0000","last_active":"2024-01-27T14:59:10.989716+0000","last_peered":"2024-01-27T14:59:10.989716+0000","last_clean":"2024-01-27T14:59:10.989716+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T14:59:10.989716+0000","last_undegraded":"2024-01-27T14:59:10.989716+0000","last_fullsized":"2024-01-27T14:59:10.989716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.160110+0000","last_change":"2024-01-27T14:31:52.000084+0000","last_active":"2024-01-27T14:59:39.160110+0000","last_peered":"2024-01-27T14:59:39.160110+0000","last_clean":"2024-01-27T14:59:39.160110+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:39.160110+0000","last_undegraded":"2024-01-27T14:59:39.160110+0000","last_fullsized":"2024-01-27T14:59:39.160110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:25.351068+0000","last_change":"2024-01-27T14:31:50.751754+0000","last_active":"2024-01-27T14:59:25.351068+0000","last_peered":"2024-01-27T14:59:25.351068+0000","last_clean":"2024-01-27T14:59:25.351068+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T14:59:25.351068+0000","last_undegraded":"2024-01-27T14:59:25.351068+0000","last_fullsized":"2024-01-27T14:59:25.351068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.948340+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:59:10.948340+0000","last_peered":"2024-01-27T14:59:10.948340+0000","last_clean":"2024-01-27T14:59:10.948340+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:59:10.948340+0000","last_undegraded":"2024-01-27T14:59:10.948340+0000","last_fullsized":"2024-01-27T14:59:10.948340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049008+0000","last_change":"2024-01-27T14:31:52.006639+0000","last_active":"2024-01-27T14:59:39.049008+0000","last_peered":"2024-01-27T14:59:39.049008+0000","last_clean":"2024-01-27T14:59:39.049008+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T14:59:39.049008+0000","last_undegraded":"2024-01-27T14:59:39.049008+0000","last_fullsized":"2024-01-27T14:59:39.049008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:20.046360+0000","last_change":"2024-01-27T14:31:50.749289+0000","last_active":"2024-01-27T14:59:20.046360+0000","last_peered":"2024-01-27T14:59:20.046360+0000","last_clean":"2024-01-27T14:59:20.046360+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:20.046360+0000","last_undegraded":"2024-01-27T14:59:20.046360+0000","last_fullsized":"2024-01-27T14:59:20.046360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:18.597709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'660","reported_seq":700,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:32.374205+0000","last_change":"2024-01-27T14:31:50.754124+0000","last_active":"2024-01-27T14:59:32.374205+0000","last_peered":"2024-01-27T14:59:32.374205+0000","last_clean":"2024-01-27T14:59:32.374205+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T14:59:32.374205+0000","last_undegraded":"2024-01-27T14:59:32.374205+0000","last_fullsized":"2024-01-27T14:59:32.374205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.158131+0000","last_change":"2024-01-27T14:31:52.009959+0000","last_active":"2024-01-27T14:59:39.158131+0000","last_peered":"2024-01-27T14:59:39.158131+0000","last_clean":"2024-01-27T14:59:39.158131+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T14:59:39.158131+0000","last_undegraded":"2024-01-27T14:59:39.158131+0000","last_fullsized":"2024-01-27T14:59:39.158131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:28.184781+0000","last_change":"2024-01-27T14:31:57.747160+0000","last_active":"2024-01-27T14:59:28.184781+0000","last_peered":"2024-01-27T14:59:28.184781+0000","last_clean":"2024-01-27T14:59:28.184781+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T14:59:28.184781+0000","last_undegraded":"2024-01-27T14:59:28.184781+0000","last_fullsized":"2024-01-27T14:59:28.184781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'688","reported_seq":728,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:38.839078+0000","last_change":"2024-01-27T14:31:50.746608+0000","last_active":"2024-01-27T14:59:38.839078+0000","last_peered":"2024-01-27T14:59:38.839078+0000","last_clean":"2024-01-27T14:59:38.839078+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:38.839078+0000","last_undegraded":"2024-01-27T14:59:38.839078+0000","last_fullsized":"2024-01-27T14:59:38.839078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:49.462525+0000","last_clean_scrub_stamp":"2024-01-27T14:31:49.462525+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.098443+0000","last_change":"2024-01-27T14:59:54.098480+0000","last_active":"2024-01-27T14:59:54.098443+0000","last_peered":"2024-01-27T14:59:54.098443+0000","last_clean":"2024-01-27T14:59:54.098443+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:54.098443+0000","last_undegraded":"2024-01-27T14:59:54.098443+0000","last_fullsized":"2024-01-27T14:59:54.098443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.098350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:00:06.958729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.799454+0000","last_change":"2024-01-27T14:31:57.751294+0000","last_active":"2024-01-27T14:59:10.799454+0000","last_peered":"2024-01-27T14:59:10.799454+0000","last_clean":"2024-01-27T14:59:10.799454+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T14:59:10.799454+0000","last_undegraded":"2024-01-27T14:59:10.799454+0000","last_fullsized":"2024-01-27T14:59:10.799454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:37.656119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065214+0000","last_change":"2024-01-27T14:31:52.010554+0000","last_active":"2024-01-27T14:59:39.065214+0000","last_peered":"2024-01-27T14:59:39.065214+0000","last_clean":"2024-01-27T14:59:39.065214+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:39.065214+0000","last_undegraded":"2024-01-27T14:59:39.065214+0000","last_fullsized":"2024-01-27T14:59:39.065214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.045705+0000","last_change":"2024-01-27T14:31:52.008476+0000","last_active":"2024-01-27T14:59:39.045705+0000","last_peered":"2024-01-27T14:59:39.045705+0000","last_clean":"2024-01-27T14:59:39.045705+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:39.045705+0000","last_undegraded":"2024-01-27T14:59:39.045705+0000","last_fullsized":"2024-01-27T14:59:39.045705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:49.303719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050839+0000","last_change":"2024-01-27T14:31:51.915941+0000","last_active":"2024-01-27T14:59:39.050839+0000","last_peered":"2024-01-27T14:59:39.050839+0000","last_clean":"2024-01-27T14:59:39.050839+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:39.050839+0000","last_undegraded":"2024-01-27T14:59:39.050839+0000","last_fullsized":"2024-01-27T14:59:39.050839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.821428+0000","last_change":"2024-01-27T14:59:53.821466+0000","last_active":"2024-01-27T14:59:53.821428+0000","last_peered":"2024-01-27T14:59:53.821428+0000","last_clean":"2024-01-27T14:59:53.821428+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:53.821428+0000","last_undegraded":"2024-01-27T14:59:53.821428+0000","last_fullsized":"2024-01-27T14:59:53.821428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.821328+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:58:09.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021084+0000","last_change":"2024-01-27T14:31:52.011259+0000","last_active":"2024-01-27T14:59:39.021084+0000","last_peered":"2024-01-27T14:59:39.021084+0000","last_clean":"2024-01-27T14:59:39.021084+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T14:59:39.021084+0000","last_undegraded":"2024-01-27T14:59:39.021084+0000","last_fullsized":"2024-01-27T14:59:39.021084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:14:43.731020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.019956+0000","last_change":"2024-01-27T14:31:52.006818+0000","last_active":"2024-01-27T14:59:39.019956+0000","last_peered":"2024-01-27T14:59:39.019956+0000","last_clean":"2024-01-27T14:59:39.019956+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T14:59:39.019956+0000","last_undegraded":"2024-01-27T14:59:39.019956+0000","last_fullsized":"2024-01-27T14:59:39.019956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:16:15.909706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.806356+0000","last_change":"2024-01-27T14:59:53.806394+0000","last_active":"2024-01-27T14:59:53.806356+0000","last_peered":"2024-01-27T14:59:53.806356+0000","last_clean":"2024-01-27T14:59:53.806356+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:53.806356+0000","last_undegraded":"2024-01-27T14:59:53.806356+0000","last_fullsized":"2024-01-27T14:59:53.806356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.806267+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:51.580529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049983+0000","last_change":"2024-01-27T14:31:51.994043+0000","last_active":"2024-01-27T14:59:39.049983+0000","last_peered":"2024-01-27T14:59:39.049983+0000","last_clean":"2024-01-27T14:59:39.049983+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T14:59:39.049983+0000","last_undegraded":"2024-01-27T14:59:39.049983+0000","last_fullsized":"2024-01-27T14:59:39.049983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.037487+0000","last_change":"2024-01-27T14:31:51.915993+0000","last_active":"2024-01-27T14:59:39.037487+0000","last_peered":"2024-01-27T14:59:39.037487+0000","last_clean":"2024-01-27T14:59:39.037487+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:39.037487+0000","last_undegraded":"2024-01-27T14:59:39.037487+0000","last_fullsized":"2024-01-27T14:59:39.037487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050201+0000","last_change":"2024-01-27T14:31:51.993819+0000","last_active":"2024-01-27T14:59:39.050201+0000","last_peered":"2024-01-27T14:59:39.050201+0000","last_clean":"2024-01-27T14:59:39.050201+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T14:59:39.050201+0000","last_undegraded":"2024-01-27T14:59:39.050201+0000","last_fullsized":"2024-01-27T14:59:39.050201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.060901+0000","last_change":"2024-01-27T14:31:52.006158+0000","last_active":"2024-01-27T14:59:39.060901+0000","last_peered":"2024-01-27T14:59:39.060901+0000","last_clean":"2024-01-27T14:59:39.060901+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:39.060901+0000","last_undegraded":"2024-01-27T14:59:39.060901+0000","last_fullsized":"2024-01-27T14:59:39.060901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.157999+0000","last_change":"2024-01-27T14:31:52.002385+0000","last_active":"2024-01-27T14:59:39.157999+0000","last_peered":"2024-01-27T14:59:39.157999+0000","last_clean":"2024-01-27T14:59:39.157999+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:39.157999+0000","last_undegraded":"2024-01-27T14:59:39.157999+0000","last_fullsized":"2024-01-27T14:59:39.157999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148703+0000","last_change":"2024-01-27T14:31:52.009116+0000","last_active":"2024-01-27T14:59:39.148703+0000","last_peered":"2024-01-27T14:59:39.148703+0000","last_clean":"2024-01-27T14:59:39.148703+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T14:59:39.148703+0000","last_undegraded":"2024-01-27T14:59:39.148703+0000","last_fullsized":"2024-01-27T14:59:39.148703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.038859+0000","last_change":"2024-01-27T14:31:52.000768+0000","last_active":"2024-01-27T14:59:39.038859+0000","last_peered":"2024-01-27T14:59:39.038859+0000","last_clean":"2024-01-27T14:59:39.038859+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T14:59:39.038859+0000","last_undegraded":"2024-01-27T14:59:39.038859+0000","last_fullsized":"2024-01-27T14:59:39.038859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048460+0000","last_change":"2024-01-27T14:31:52.009091+0000","last_active":"2024-01-27T14:59:39.048460+0000","last_peered":"2024-01-27T14:59:39.048460+0000","last_clean":"2024-01-27T14:59:39.048460+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T14:59:39.048460+0000","last_undegraded":"2024-01-27T14:59:39.048460+0000","last_fullsized":"2024-01-27T14:59:39.048460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:43.948909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.062572+0000","last_change":"2024-01-27T14:31:52.009009+0000","last_active":"2024-01-27T14:59:52.062572+0000","last_peered":"2024-01-27T14:59:52.062572+0000","last_clean":"2024-01-27T14:59:52.062572+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T14:59:52.062572+0000","last_undegraded":"2024-01-27T14:59:52.062572+0000","last_fullsized":"2024-01-27T14:59:52.062572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.062485+0000","last_change":"2024-01-27T14:31:51.993869+0000","last_active":"2024-01-27T14:59:52.062485+0000","last_peered":"2024-01-27T14:59:52.062485+0000","last_clean":"2024-01-27T14:59:52.062485+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:52.062485+0000","last_undegraded":"2024-01-27T14:59:52.062485+0000","last_fullsized":"2024-01-27T14:59:52.062485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.658264+0000","last_change":"2024-01-27T14:31:52.005973+0000","last_active":"2024-01-27T14:59:53.658264+0000","last_peered":"2024-01-27T14:59:53.658264+0000","last_clean":"2024-01-27T14:59:53.658264+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:53.658264+0000","last_undegraded":"2024-01-27T14:59:53.658264+0000","last_fullsized":"2024-01-27T14:59:53.658264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.021085+0000","last_change":"2024-01-27T14:31:52.007640+0000","last_active":"2024-01-27T14:59:39.021085+0000","last_peered":"2024-01-27T14:59:39.021085+0000","last_clean":"2024-01-27T14:59:39.021085+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T14:59:39.021085+0000","last_undegraded":"2024-01-27T14:59:39.021085+0000","last_fullsized":"2024-01-27T14:59:39.021085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:28:41.657546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.020831+0000","last_change":"2024-01-27T14:31:52.005620+0000","last_active":"2024-01-27T14:59:39.020831+0000","last_peered":"2024-01-27T14:59:39.020831+0000","last_clean":"2024-01-27T14:59:39.020831+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:39.020831+0000","last_undegraded":"2024-01-27T14:59:39.020831+0000","last_fullsized":"2024-01-27T14:59:39.020831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:20:27.571472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148387+0000","last_change":"2024-01-27T14:31:52.007205+0000","last_active":"2024-01-27T14:59:39.148387+0000","last_peered":"2024-01-27T14:59:39.148387+0000","last_clean":"2024-01-27T14:59:39.148387+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:39.148387+0000","last_undegraded":"2024-01-27T14:59:39.148387+0000","last_fullsized":"2024-01-27T14:59:39.148387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:50.525972+0000","last_change":"2024-01-27T14:59:50.526009+0000","last_active":"2024-01-27T14:59:50.525972+0000","last_peered":"2024-01-27T14:59:50.525972+0000","last_clean":"2024-01-27T14:59:50.525972+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:50.525972+0000","last_undegraded":"2024-01-27T14:59:50.525972+0000","last_fullsized":"2024-01-27T14:59:50.525972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_clean_scrub_stamp":"2024-01-27T14:59:50.525903+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:25.998821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.148851+0000","last_change":"2024-01-27T14:31:52.005645+0000","last_active":"2024-01-27T14:59:39.148851+0000","last_peered":"2024-01-27T14:59:39.148851+0000","last_clean":"2024-01-27T14:59:39.148851+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:39.148851+0000","last_undegraded":"2024-01-27T14:59:39.148851+0000","last_fullsized":"2024-01-27T14:59:39.148851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.058353+0000","last_change":"2024-01-27T14:31:51.995546+0000","last_active":"2024-01-27T14:59:39.058353+0000","last_peered":"2024-01-27T14:59:39.058353+0000","last_clean":"2024-01-27T14:59:39.058353+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:39.058353+0000","last_undegraded":"2024-01-27T14:59:39.058353+0000","last_fullsized":"2024-01-27T14:59:39.058353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050948+0000","last_change":"2024-01-27T14:31:52.008767+0000","last_active":"2024-01-27T14:59:39.050948+0000","last_peered":"2024-01-27T14:59:39.050948+0000","last_clean":"2024-01-27T14:59:39.050948+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T14:59:39.050948+0000","last_undegraded":"2024-01-27T14:59:39.050948+0000","last_fullsized":"2024-01-27T14:59:39.050948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.129380+0000","last_change":"2024-01-27T14:31:52.012503+0000","last_active":"2024-01-27T14:59:39.129380+0000","last_peered":"2024-01-27T14:59:39.129380+0000","last_clean":"2024-01-27T14:59:39.129380+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T14:59:39.129380+0000","last_undegraded":"2024-01-27T14:59:39.129380+0000","last_fullsized":"2024-01-27T14:59:39.129380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.065943+0000","last_change":"2024-01-27T14:31:52.003717+0000","last_active":"2024-01-27T14:59:39.065943+0000","last_peered":"2024-01-27T14:59:39.065943+0000","last_clean":"2024-01-27T14:59:39.065943+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:39.065943+0000","last_undegraded":"2024-01-27T14:59:39.065943+0000","last_fullsized":"2024-01-27T14:59:39.065943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.050457+0000","last_change":"2024-01-27T14:32:21.652299+0000","last_active":"2024-01-27T14:59:39.050457+0000","last_peered":"2024-01-27T14:59:39.050457+0000","last_clean":"2024-01-27T14:59:39.050457+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T14:59:39.050457+0000","last_undegraded":"2024-01-27T14:59:39.050457+0000","last_fullsized":"2024-01-27T14:59:39.050457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:28:33.953857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.251629+0000","last_change":"2024-01-27T14:31:52.003243+0000","last_active":"2024-01-27T14:59:51.251629+0000","last_peered":"2024-01-27T14:59:51.251629+0000","last_clean":"2024-01-27T14:59:51.251629+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:51.251629+0000","last_undegraded":"2024-01-27T14:59:51.251629+0000","last_fullsized":"2024-01-27T14:59:51.251629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.048849+0000","last_change":"2024-01-27T14:31:52.003839+0000","last_active":"2024-01-27T14:59:39.048849+0000","last_peered":"2024-01-27T14:59:39.048849+0000","last_clean":"2024-01-27T14:59:39.048849+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:39.048849+0000","last_undegraded":"2024-01-27T14:59:39.048849+0000","last_fullsized":"2024-01-27T14:59:39.048849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.049154+0000","last_change":"2024-01-27T14:31:52.010030+0000","last_active":"2024-01-27T14:59:39.049154+0000","last_peered":"2024-01-27T14:59:39.049154+0000","last_clean":"2024-01-27T14:59:39.049154+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T14:59:39.049154+0000","last_undegraded":"2024-01-27T14:59:39.049154+0000","last_fullsized":"2024-01-27T14:59:39.049154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:39.124727+0000","last_change":"2024-01-27T14:31:52.005842+0000","last_active":"2024-01-27T14:59:39.124727+0000","last_peered":"2024-01-27T14:59:39.124727+0000","last_clean":"2024-01-27T14:59:39.124727+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:39.124727+0000","last_undegraded":"2024-01-27T14:59:39.124727+0000","last_fullsized":"2024-01-27T14:59:39.124727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:50.589163+0000","last_clean_scrub_stamp":"2024-01-27T14:31:50.589163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8267,"ondisk_log_size":8267,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.58399999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.41699999999999998},"min":{"1min":0.32100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65200000000000002},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.434},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.80100000000000005},"last":0.498}]},{"osd":2,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60799999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.432,"5min":0.442,"15min":0.441},"min":{"1min":0.33000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.54000000000000004,"5min":0.64200000000000002,"15min":0.66100000000000003},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.44600000000000001,"5min":0.60499999999999998,"15min":0.76900000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.55800000000000005,"15min":0.621},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.46600000000000003,"5min":0.54000000000000004,"15min":0.59899999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.39200000000000002}]},{"osd":6,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.58199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.442}]},{"osd":1,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.67100000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.64000000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66500000000000004},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.65500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61899999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.309},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.71999999999999997},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.58599999999999997},"last":0.371}]},{"osd":7,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.441,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73699999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.19,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.495,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.312},"min":{"1min":0.20899999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.437,"5min":0.47099999999999997,"15min":0.57499999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.185},"max":{"1min":0.45900000000000002,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.34999999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52500000000000002,"15min":0.68200000000000005},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.53700000000000003,"15min":0.64800000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.378},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.72499999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.432,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.71599999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.71899999999999997},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.66200000000000003,"15min":0.68899999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.753},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.41599999999999998,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.78000000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.39100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66400000000000003,"5min":0.67600000000000005,"15min":0.79500000000000004},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Jan 27 14:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.75600000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.502,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.59399999999999997,"5min":0.73199999999999998,"15min":0.76000000000000001},"last":0.57599999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.28599999999999998,"15min":0.28999999999999998},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.375,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":0.58499999999999996,"15min":0.59699999999999998},"last":0.28399999999999997}]},{"osd":1,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.42699999999999999,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.313},"max":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.442,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.73799999999999999}]},{"osd":5,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.65700000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54800000000000004,"5min":0.752,"15min":0.752},"last":0.68300000000000005}]},{"osd":7,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509784,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.51800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.25600000000000001}]},{"osd":2,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.191},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.27200000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.248},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.442},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.747},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39900000000000002}]},{"osd":6,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.28999999999999998},"max":{"1min":0.628,"5min":0.872,"15min":0.872},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"last":0.42799999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38500000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509784,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":0.45700000000000002,"5min":0.47699999999999998,"15min":0.53700000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.315},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.55000000000000004,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.217}]},{"osd":2,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.61399999999999999},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.192,"15min":0.192},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.224},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.63800000000000001,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.68600000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.497,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.70599999999999996},"last":0.497}]}]},{"osd":6,"up_from":14,"seq":60129542489,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.23699999999999999},"max":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.438,"15min":0.42599999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.317,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.375}]},{"osd":2,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41999999999999998,"15min":0.42499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.443,"15min":0.433},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67400000000000004},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:10 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.625},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.65600000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52000000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542490,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.439},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.28100000000000003}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.376}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:59:55.958 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.958 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.958 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.958 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.959 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.960 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.961 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.962 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.963 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.964 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.965 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.966 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-27T14:31:49.462525+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=49, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.967 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.968 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.969 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.970 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.971 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.971 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-27T14:31:50.589163+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=50, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:59:55.971 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-27T15:00:03.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:00:03.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:00:15.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T15:00:16.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.080+0000 7f9c86e90640 1 Processor -- start 2024-01-27T15:00:16.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.080+0000 7f9c86e90640 1 -- start start 2024-01-27T15:00:16.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.081+0000 7f9c86e90640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 0x7f9c800cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:16.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.081+0000 7f9c86e90640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c80153e10 con 0x7f9c8006c630 2024-01-27T15:00:16.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.081+0000 7f9c86e90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8006ba90 con 0x7f9c800cd360 2024-01-27T15:00:16.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.081+0000 7f9c86e90640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8015cce0 con 0x7f9c80153a30 2024-01-27T15:00:16.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.082+0000 7f9c8542d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c8006c630 0x7f9c80159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59580/0 (socket says 172.21.15.46:59580) 2024-01-27T15:00:16.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.082+0000 7f9c8542d640 1 -- 172.21.15.46:0/3916975535 learned_addr learned my addr 172.21.15.46:0/3916975535 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:16.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.082+0000 7f9c84c2c640 1 --2- 172.21.15.46:0/3916975535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 0x7f9c800cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:16.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.084+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134407442 0 0) 0x7f9c80153e10 con 0x7f9c8006c630 2024-01-27T15:00:16.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.084+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c68003520 con 0x7f9c8006c630 2024-01-27T15:00:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.085+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952317824 0 0) 0x7f9c8006ba90 con 0x7f9c800cd360 2024-01-27T15:00:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.085+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c80153e10 con 0x7f9c800cd360 2024-01-27T15:00:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.085+0000 7f9c84c2c640 1 -- 172.21.15.46:0/3916975535 >> v1:172.21.15.73:6789/0 conn(0x7f9c800cd360 legacy=0x7f9c8006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.085+0000 7f9c84c2c640 1 -- 172.21.15.46:0/3916975535 >> v1:172.21.15.46:6789/0 conn(0x7f9c8006c630 legacy=0x7f9c80159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.085+0000 7f9c84c2c640 1 -- 172.21.15.46:0/3916975535 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8015cf80 con 0x7f9c80153a30 2024-01-27T15:00:16.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.088+0000 7f9c84c2c640 1 --2- 172.21.15.46:0/3916975535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 0x7f9c800cce20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009dc0 tx=0x7f9c7802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a920ad5a9c2a2655 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.091+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7802cd50 con 0x7f9c80153a30 2024-01-27T15:00:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.091+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c78034440 con 0x7f9c80153a30 2024-01-27T15:00:16.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.091+0000 7f9c7f7fe640 1 -- 172.21.15.46:0/3916975535 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780347d0 con 0x7f9c80153a30 2024-01-27T15:00:16.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 -- 172.21.15.46:0/3916975535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 msgr2=0x7f9c800cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 --2- 172.21.15.46:0/3916975535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 0x7f9c800cce20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009dc0 tx=0x7f9c7802bfa0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 -- 172.21.15.46:0/3916975535 shutdown_connections 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 --2- 172.21.15.46:0/3916975535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c80153a30 0x7f9c800cce20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 -- 172.21.15.46:0/3916975535 >> 172.21.15.46:0/3916975535 conn(0x7f9c8006a6c0 msgr2=0x7f9c8006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 -- 172.21.15.46:0/3916975535 shutdown_connections 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.092+0000 7f9c86e90640 1 -- 172.21.15.46:0/3916975535 wait complete. 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.093+0000 7f9c86e90640 1 Processor -- start 2024-01-27T15:00:16.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.093+0000 7f9c86e90640 1 -- start start 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c800cd360 0x7f9c800cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c80153a30 0x7f9c8013e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801f2f20 con 0x7f9c8006c630 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80156950 con 0x7f9c80153a30 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.094+0000 7f9c86e90640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80156c30 con 0x7f9c800cd360 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.095+0000 7f9c84c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.095+0000 7f9c8542d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c80153a30 0x7f9c8013e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.095+0000 7f9c7ffff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c800cd360 0x7f9c800cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:16.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.095+0000 7f9c84c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51694/0 (socket says 172.21.15.46:51694) 2024-01-27T15:00:16.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.095+0000 7f9c84c2c640 1 -- 172.21.15.46:0/858556883 learned_addr learned my addr 172.21.15.46:0/858556883 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:16.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.099+0000 7f9c84c2c640 1 -- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c800cd360 msgr2=0x7f9c800cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.099+0000 7f9c84c2c640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c800cd360 0x7f9c800cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.099+0000 7f9c84c2c640 1 -- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c80153a30 msgr2=0x7f9c8013e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.099+0000 7f9c84c2c640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c80153a30 0x7f9c8013e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.099+0000 7f9c84c2c640 1 -- 172.21.15.46:0/858556883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009a70 con 0x7f9c8006c630 2024-01-27T15:00:16.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.101+0000 7f9c84c2c640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f80 tx=0x7f9c78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.105+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78040650 con 0x7f9c8006c630 2024-01-27T15:00:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.105+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780407b0 con 0x7f9c8006c630 2024-01-27T15:00:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.105+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78040b60 con 0x7f9c8006c630 2024-01-27T15:00:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.105+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c80154040 con 0x7f9c8006c630 2024-01-27T15:00:16.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.105+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c80154600 con 0x7f9c8006c630 2024-01-27T15:00:16.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.106+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8006d960 con 0x7f9c8006c630 2024-01-27T15:00:16.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.127+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9c78040cc0 con 0x7f9c8006c630 2024-01-27T15:00:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.127+0000 7f9c7d7fa640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 0x7f9c6c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.127+0000 7f9c7ffff640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 0x7f9c6c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.128+0000 7f9c7ffff640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 0x7f9c6c06d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.386+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9c7804ae20 con 0x7f9c8006c630 2024-01-27T15:00:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.386+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9c78077760 con 0x7f9c8006c630 2024-01-27T15:00:16.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.582+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c8015d540 con 0x7f9c6c06af50 2024-01-27T15:00:16.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.592+0000 7f9c7d7fa640 1 -- 172.21.15.46:0/858556883 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371430 (secure 0 0 0) 0x7f9c74001470 con 0x7f9c6c06af50 2024-01-27T15:00:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T15:00:16.600 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T15:00:16.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 msgr2=0x7f9c6c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 0x7f9c6c06d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74009040 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 msgr2=0x7f9c801f29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f80 tx=0x7f9c78004a40 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 shutdown_connections 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f9c6c06af50 0x7f9c6c06d410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c80153a30 0x7f9c8013e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c800cd360 0x7f9c800cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 --2- 172.21.15.46:0/858556883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c8006c630 0x7f9c801f29e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 >> 172.21.15.46:0/858556883 conn(0x7f9c8006a6c0 msgr2=0x7f9c8006b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 shutdown_connections 2024-01-27T15:00:16.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:16.596+0000 7f9c86e90640 1 -- 172.21.15.46:0/858556883 wait complete. 2024-01-27T15:00:16.609 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":887,"stamp":"2024-01-27T15:00:15.394135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15429,"ondisk_log_size":15429,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":476160,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":393651,"kb_avail":754498560,"statfs":{"total":773094113280,"available":772606525440,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":403099185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"2.1f","version":"29'622","reported_seq":670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.864523+0000","last_change":"2024-01-27T14:59:57.864553+0000","last_active":"2024-01-27T14:59:57.864523+0000","last_peered":"2024-01-27T14:59:57.864523+0000","last_clean":"2024-01-27T14:59:57.864523+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:57.864523+0000","last_undegraded":"2024-01-27T14:59:57.864523+0000","last_fullsized":"2024-01-27T14:59:57.864523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'622","last_scrub_stamp":"2024-01-27T14:59:57.864462+0000","last_deep_scrub":"29'622","last_deep_scrub_stamp":"2024-01-27T14:59:57.864462+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.864462+0000","objects_scrubbed":7,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:05:36.297621+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.952610+0000","last_change":"2024-01-27T15:00:02.952634+0000","last_active":"2024-01-27T15:00:02.952610+0000","last_peered":"2024-01-27T15:00:02.952610+0000","last_clean":"2024-01-27T15:00:02.952610+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T15:00:02.952610+0000","last_undegraded":"2024-01-27T15:00:02.952610+0000","last_fullsized":"2024-01-27T15:00:02.952610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-01-27T15:00:02.952543+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-01-27T15:00:02.952543+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.952543+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:25.990345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.269818+0000","last_change":"2024-01-27T15:00:05.269843+0000","last_active":"2024-01-27T15:00:05.269818+0000","last_peered":"2024-01-27T15:00:05.269818+0000","last_clean":"2024-01-27T15:00:05.269818+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T15:00:05.269818+0000","last_undegraded":"2024-01-27T15:00:05.269818+0000","last_fullsized":"2024-01-27T15:00:05.269818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'167","last_scrub_stamp":"2024-01-27T15:00:05.269733+0000","last_deep_scrub":"29'167","last_deep_scrub_stamp":"2024-01-27T15:00:05.269733+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.269733+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:59.970041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'729","reported_seq":780,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.899479+0000","last_change":"2024-01-27T15:00:00.899504+0000","last_active":"2024-01-27T15:00:00.899479+0000","last_peered":"2024-01-27T15:00:00.899479+0000","last_clean":"2024-01-27T15:00:00.899479+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T15:00:00.899479+0000","last_undegraded":"2024-01-27T15:00:00.899479+0000","last_fullsized":"2024-01-27T15:00:00.899479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'729","last_scrub_stamp":"2024-01-27T15:00:00.899411+0000","last_deep_scrub":"29'729","last_deep_scrub_stamp":"2024-01-27T15:00:00.899411+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.899411+0000","objects_scrubbed":1,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:27.804260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.921476+0000","last_change":"2024-01-27T14:59:56.921497+0000","last_active":"2024-01-27T14:59:56.921476+0000","last_peered":"2024-01-27T14:59:56.921476+0000","last_clean":"2024-01-27T14:59:56.921476+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:56.921476+0000","last_undegraded":"2024-01-27T14:59:56.921476+0000","last_fullsized":"2024-01-27T14:59:56.921476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:56.921401+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:56.921401+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.921401+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:51:40.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.761458+0000","last_change":"2024-01-27T15:00:03.761485+0000","last_active":"2024-01-27T15:00:03.761458+0000","last_peered":"2024-01-27T15:00:03.761458+0000","last_clean":"2024-01-27T15:00:03.761458+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T15:00:03.761458+0000","last_undegraded":"2024-01-27T15:00:03.761458+0000","last_fullsized":"2024-01-27T15:00:03.761458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2024-01-27T15:00:03.761387+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2024-01-27T15:00:03.761387+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.761387+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:46.373772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1360","reported_seq":1407,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.458573+0000","last_change":"2024-01-27T14:59:54.458630+0000","last_active":"2024-01-27T14:59:54.458573+0000","last_peered":"2024-01-27T14:59:54.458573+0000","last_clean":"2024-01-27T14:59:54.458573+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:54.458573+0000","last_undegraded":"2024-01-27T14:59:54.458573+0000","last_fullsized":"2024-01-27T14:59:54.458573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1360","last_scrub_stamp":"2024-01-27T14:59:54.458492+0000","last_deep_scrub":"29'1360","last_deep_scrub_stamp":"2024-01-27T14:59:54.458492+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.458492+0000","objects_scrubbed":9,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:41:58.893624+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.106461+0000","last_change":"2024-01-27T14:59:56.106483+0000","last_active":"2024-01-27T14:59:56.106461+0000","last_peered":"2024-01-27T14:59:56.106461+0000","last_clean":"2024-01-27T14:59:56.106461+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:56.106461+0000","last_undegraded":"2024-01-27T14:59:56.106461+0000","last_fullsized":"2024-01-27T14:59:56.106461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-01-27T14:59:56.106405+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-01-27T14:59:56.106405+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.106405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:57:44.679705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.783418+0000","last_change":"2024-01-27T15:00:04.783442+0000","last_active":"2024-01-27T15:00:04.783418+0000","last_peered":"2024-01-27T15:00:04.783418+0000","last_clean":"2024-01-27T15:00:04.783418+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T15:00:04.783418+0000","last_undegraded":"2024-01-27T15:00:04.783418+0000","last_fullsized":"2024-01-27T15:00:04.783418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'138","last_scrub_stamp":"2024-01-27T15:00:04.783339+0000","last_deep_scrub":"29'138","last_deep_scrub_stamp":"2024-01-27T15:00:04.783339+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.783339+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:31.688188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.514130+0000","last_change":"2024-01-27T14:59:51.514187+0000","last_active":"2024-01-27T14:59:51.514130+0000","last_peered":"2024-01-27T14:59:51.514130+0000","last_clean":"2024-01-27T14:59:51.514130+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:51.514130+0000","last_undegraded":"2024-01-27T14:59:51.514130+0000","last_fullsized":"2024-01-27T14:59:51.514130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.514059+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:51.256705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:10.957061+0000","last_change":"2024-01-27T15:00:10.957084+0000","last_active":"2024-01-27T15:00:10.957061+0000","last_peered":"2024-01-27T15:00:10.957061+0000","last_clean":"2024-01-27T15:00:10.957061+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T15:00:10.957061+0000","last_undegraded":"2024-01-27T15:00:10.957061+0000","last_fullsized":"2024-01-27T15:00:10.957061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-01-27T15:00:10.956990+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-01-27T15:00:10.956990+0000","last_clean_scrub_stamp":"2024-01-27T15:00:10.956990+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:27:02.821309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.793380+0000","last_change":"2024-01-27T15:00:02.793405+0000","last_active":"2024-01-27T15:00:02.793380+0000","last_peered":"2024-01-27T15:00:02.793380+0000","last_clean":"2024-01-27T15:00:02.793380+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T15:00:02.793380+0000","last_undegraded":"2024-01-27T15:00:02.793380+0000","last_fullsized":"2024-01-27T15:00:02.793380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2024-01-27T15:00:02.793303+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2024-01-27T15:00:02.793303+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.793303+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:21:01.752434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.104191+0000","last_change":"2024-01-27T14:59:54.104191+0000","last_active":"2024-01-27T14:59:54.104191+0000","last_peered":"2024-01-27T14:59:54.104191+0000","last_clean":"2024-01-27T14:59:54.104191+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:54.104191+0000","last_undegraded":"2024-01-27T14:59:54.104191+0000","last_fullsized":"2024-01-27T14:59:54.104191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.104043+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:24:13.209696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'586","reported_seq":635,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.996589+0000","last_change":"2024-01-27T15:00:01.996624+0000","last_active":"2024-01-27T15:00:01.996589+0000","last_peered":"2024-01-27T15:00:01.996589+0000","last_clean":"2024-01-27T15:00:01.996589+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T15:00:01.996589+0000","last_undegraded":"2024-01-27T15:00:01.996589+0000","last_fullsized":"2024-01-27T15:00:01.996589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'586","last_scrub_stamp":"2024-01-27T15:00:01.996513+0000","last_deep_scrub":"29'586","last_deep_scrub_stamp":"2024-01-27T15:00:01.996513+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.996513+0000","objects_scrubbed":3,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:07:35.972358+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.826942+0000","last_change":"2024-01-27T14:31:57.741767+0000","last_active":"2024-01-27T14:59:10.826942+0000","last_peered":"2024-01-27T14:59:10.826942+0000","last_clean":"2024-01-27T14:59:10.826942+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T14:59:10.826942+0000","last_undegraded":"2024-01-27T14:59:10.826942+0000","last_fullsized":"2024-01-27T14:59:10.826942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.240823+0000","last_change":"2024-01-27T15:00:00.240861+0000","last_active":"2024-01-27T15:00:00.240823+0000","last_peered":"2024-01-27T15:00:00.240823+0000","last_clean":"2024-01-27T15:00:00.240823+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T15:00:00.240823+0000","last_undegraded":"2024-01-27T15:00:00.240823+0000","last_fullsized":"2024-01-27T15:00:00.240823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T15:00:00.240746+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T15:00:00.240746+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.240746+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:28:36.734035+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.234471+0000","last_change":"2024-01-27T14:59:55.234471+0000","last_active":"2024-01-27T14:59:55.234471+0000","last_peered":"2024-01-27T14:59:55.234471+0000","last_clean":"2024-01-27T14:59:55.234471+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:59:55.234471+0000","last_undegraded":"2024-01-27T14:59:55.234471+0000","last_fullsized":"2024-01-27T14:59:55.234471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-01-27T14:59:55.234378+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-01-27T14:59:55.234378+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.234378+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:30.275296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.429962+0000","last_change":"2024-01-27T15:00:06.429988+0000","last_active":"2024-01-27T15:00:06.429962+0000","last_peered":"2024-01-27T15:00:06.429962+0000","last_clean":"2024-01-27T15:00:06.429962+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T15:00:06.429962+0000","last_undegraded":"2024-01-27T15:00:06.429962+0000","last_fullsized":"2024-01-27T15:00:06.429962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'162","last_scrub_stamp":"2024-01-27T15:00:06.429886+0000","last_deep_scrub":"29'162","last_deep_scrub_stamp":"2024-01-27T15:00:06.429886+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.429886+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:51:20.969650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.890644+0000","last_change":"2024-01-27T14:59:52.890644+0000","last_active":"2024-01-27T14:59:52.890644+0000","last_peered":"2024-01-27T14:59:52.890644+0000","last_clean":"2024-01-27T14:59:52.890644+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:52.890644+0000","last_undegraded":"2024-01-27T14:59:52.890644+0000","last_fullsized":"2024-01-27T14:59:52.890644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.890548+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:40:48.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.934725+0000","last_change":"2024-01-27T14:59:53.934725+0000","last_active":"2024-01-27T14:59:53.934725+0000","last_peered":"2024-01-27T14:59:53.934725+0000","last_clean":"2024-01-27T14:59:53.934725+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:53.934725+0000","last_undegraded":"2024-01-27T14:59:53.934725+0000","last_fullsized":"2024-01-27T14:59:53.934725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-01-27T14:59:53.934640+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-01-27T14:59:53.934640+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.934640+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:08.484277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.265363+0000","last_change":"2024-01-27T15:00:02.265389+0000","last_active":"2024-01-27T15:00:02.265363+0000","last_peered":"2024-01-27T15:00:02.265363+0000","last_clean":"2024-01-27T15:00:02.265363+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T15:00:02.265363+0000","last_undegraded":"2024-01-27T15:00:02.265363+0000","last_fullsized":"2024-01-27T15:00:02.265363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'133","last_scrub_stamp":"2024-01-27T15:00:02.265286+0000","last_deep_scrub":"29'133","last_deep_scrub_stamp":"2024-01-27T15:00:02.265286+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.265286+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:37.738203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.026301+0000","last_change":"2024-01-27T15:00:00.026301+0000","last_active":"2024-01-27T15:00:00.026301+0000","last_peered":"2024-01-27T15:00:00.026301+0000","last_clean":"2024-01-27T15:00:00.026301+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T15:00:00.026301+0000","last_undegraded":"2024-01-27T15:00:00.026301+0000","last_fullsized":"2024-01-27T15:00:00.026301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:00.026204+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:00.026204+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.026204+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:10:48.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'7","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.519205+0000","last_change":"2024-01-27T14:59:52.519205+0000","last_active":"2024-01-27T14:59:52.519205+0000","last_peered":"2024-01-27T14:59:52.519205+0000","last_clean":"2024-01-27T14:59:52.519205+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:52.519205+0000","last_undegraded":"2024-01-27T14:59:52.519205+0000","last_fullsized":"2024-01-27T14:59:52.519205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.519116+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:32:55.885458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.858961+0000","last_change":"2024-01-27T14:59:59.858989+0000","last_active":"2024-01-27T14:59:59.858961+0000","last_peered":"2024-01-27T14:59:59.858961+0000","last_clean":"2024-01-27T14:59:59.858961+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:59.858961+0000","last_undegraded":"2024-01-27T14:59:59.858961+0000","last_fullsized":"2024-01-27T14:59:59.858961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'115","last_scrub_stamp":"2024-01-27T14:59:59.858877+0000","last_deep_scrub":"29'115","last_deep_scrub_stamp":"2024-01-27T14:59:59.858877+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.858877+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:51:30.642384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.812041+0000","last_change":"2024-01-27T15:00:02.812041+0000","last_active":"2024-01-27T15:00:02.812041+0000","last_peered":"2024-01-27T15:00:02.812041+0000","last_clean":"2024-01-27T15:00:02.812041+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T15:00:02.812041+0000","last_undegraded":"2024-01-27T15:00:02.812041+0000","last_fullsized":"2024-01-27T15:00:02.812041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-01-27T15:00:02.811957+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-01-27T15:00:02.811957+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.811957+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:41:33.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'18","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.036805+0000","last_change":"2024-01-27T15:00:01.036805+0000","last_active":"2024-01-27T15:00:01.036805+0000","last_peered":"2024-01-27T15:00:01.036805+0000","last_clean":"2024-01-27T15:00:01.036805+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T15:00:01.036805+0000","last_undegraded":"2024-01-27T15:00:01.036805+0000","last_fullsized":"2024-01-27T15:00:01.036805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-01-27T15:00:01.036662+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-01-27T15:00:01.036662+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.036662+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:54:35.448159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.777394+0000","last_change":"2024-01-27T15:00:05.777420+0000","last_active":"2024-01-27T15:00:05.777394+0000","last_peered":"2024-01-27T15:00:05.777394+0000","last_clean":"2024-01-27T15:00:05.777394+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T15:00:05.777394+0000","last_undegraded":"2024-01-27T15:00:05.777394+0000","last_fullsized":"2024-01-27T15:00:05.777394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'154","last_scrub_stamp":"2024-01-27T15:00:05.777327+0000","last_deep_scrub":"29'154","last_deep_scrub_stamp":"2024-01-27T15:00:05.777327+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.777327+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:31.595434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.839004+0000","last_change":"2024-01-27T15:00:01.839004+0000","last_active":"2024-01-27T15:00:01.839004+0000","last_peered":"2024-01-27T15:00:01.839004+0000","last_clean":"2024-01-27T15:00:01.839004+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T15:00:01.839004+0000","last_undegraded":"2024-01-27T15:00:01.839004+0000","last_fullsized":"2024-01-27T15:00:01.839004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:01.838919+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:01.838919+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.838919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:56.795815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'319","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.921420+0000","last_change":"2024-01-27T14:59:54.921420+0000","last_active":"2024-01-27T14:59:54.921420+0000","last_peered":"2024-01-27T14:59:54.921420+0000","last_clean":"2024-01-27T14:59:54.921420+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:54.921420+0000","last_undegraded":"2024-01-27T14:59:54.921420+0000","last_fullsized":"2024-01-27T14:59:54.921420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'319","last_scrub_stamp":"2024-01-27T14:59:54.921271+0000","last_deep_scrub":"29'319","last_deep_scrub_stamp":"2024-01-27T14:59:54.921271+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.921271+0000","objects_scrubbed":4,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:01:25.624484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.775159+0000","last_change":"2024-01-27T15:00:05.775180+0000","last_active":"2024-01-27T15:00:05.775159+0000","last_peered":"2024-01-27T15:00:05.775159+0000","last_clean":"2024-01-27T15:00:05.775159+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T15:00:05.775159+0000","last_undegraded":"2024-01-27T15:00:05.775159+0000","last_fullsized":"2024-01-27T15:00:05.775159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2024-01-27T15:00:05.775092+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2024-01-27T15:00:05.775092+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.775092+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:09:10.343605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.200619+0000","last_change":"2024-01-27T15:00:02.200644+0000","last_active":"2024-01-27T15:00:02.200619+0000","last_peered":"2024-01-27T15:00:02.200619+0000","last_clean":"2024-01-27T15:00:02.200619+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T15:00:02.200619+0000","last_undegraded":"2024-01-27T15:00:02.200619+0000","last_fullsized":"2024-01-27T15:00:02.200619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:02.200539+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:02.200539+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.200539+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:08.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'11","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.968360+0000","last_change":"2024-01-27T15:00:05.968385+0000","last_active":"2024-01-27T15:00:05.968360+0000","last_peered":"2024-01-27T15:00:05.968360+0000","last_clean":"2024-01-27T15:00:05.968360+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T15:00:05.968360+0000","last_undegraded":"2024-01-27T15:00:05.968360+0000","last_fullsized":"2024-01-27T15:00:05.968360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-01-27T15:00:05.968299+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-01-27T15:00:05.968299+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.968299+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:38:48.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":160,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.104875+0000","last_change":"2024-01-27T15:00:08.104915+0000","last_active":"2024-01-27T15:00:08.104875+0000","last_peered":"2024-01-27T15:00:08.104875+0000","last_clean":"2024-01-27T15:00:08.104875+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T15:00:08.104875+0000","last_undegraded":"2024-01-27T15:00:08.104875+0000","last_fullsized":"2024-01-27T15:00:08.104875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'120","last_scrub_stamp":"2024-01-27T15:00:08.104787+0000","last_deep_scrub":"29'120","last_deep_scrub_stamp":"2024-01-27T15:00:08.104787+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.104787+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:04:33.523806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.764160+0000","last_change":"2024-01-27T14:59:56.764183+0000","last_active":"2024-01-27T14:59:56.764160+0000","last_peered":"2024-01-27T14:59:56.764160+0000","last_clean":"2024-01-27T14:59:56.764160+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:56.764160+0000","last_undegraded":"2024-01-27T14:59:56.764160+0000","last_fullsized":"2024-01-27T14:59:56.764160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:56.764086+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:56.764086+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.764086+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:33:00.130428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.926032+0000","last_change":"2024-01-27T14:59:57.926055+0000","last_active":"2024-01-27T14:59:57.926032+0000","last_peered":"2024-01-27T14:59:57.926032+0000","last_clean":"2024-01-27T14:59:57.926032+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:59:57.926032+0000","last_undegraded":"2024-01-27T14:59:57.926032+0000","last_fullsized":"2024-01-27T14:59:57.926032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-27T14:59:57.925963+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-27T14:59:57.925963+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.925963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:23:43.628346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.138569+0000","last_change":"2024-01-27T15:00:05.138593+0000","last_active":"2024-01-27T15:00:05.138569+0000","last_peered":"2024-01-27T15:00:05.138569+0000","last_clean":"2024-01-27T15:00:05.138569+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T15:00:05.138569+0000","last_undegraded":"2024-01-27T15:00:05.138569+0000","last_fullsized":"2024-01-27T15:00:05.138569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'197","last_scrub_stamp":"2024-01-27T15:00:05.138497+0000","last_deep_scrub":"29'197","last_deep_scrub_stamp":"2024-01-27T15:00:05.138497+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.138497+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:19:41.247455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.424296+0000","last_change":"2024-01-27T15:00:00.424342+0000","last_active":"2024-01-27T15:00:00.424296+0000","last_peered":"2024-01-27T15:00:00.424296+0000","last_clean":"2024-01-27T15:00:00.424296+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T15:00:00.424296+0000","last_undegraded":"2024-01-27T15:00:00.424296+0000","last_fullsized":"2024-01-27T15:00:00.424296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T15:00:00.424209+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T15:00:00.424209+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.424209+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:43.036593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.963017+0000","last_change":"2024-01-27T15:00:07.963042+0000","last_active":"2024-01-27T15:00:07.963017+0000","last_peered":"2024-01-27T15:00:07.963017+0000","last_clean":"2024-01-27T15:00:07.963017+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T15:00:07.963017+0000","last_undegraded":"2024-01-27T15:00:07.963017+0000","last_fullsized":"2024-01-27T15:00:07.963017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-01-27T15:00:07.962954+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-01-27T15:00:07.962954+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.962954+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:03:37.223074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.144900+0000","last_change":"2024-01-27T15:00:09.144924+0000","last_active":"2024-01-27T15:00:09.144900+0000","last_peered":"2024-01-27T15:00:09.144900+0000","last_clean":"2024-01-27T15:00:09.144900+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T15:00:09.144900+0000","last_undegraded":"2024-01-27T15:00:09.144900+0000","last_fullsized":"2024-01-27T15:00:09.144900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'123","last_scrub_stamp":"2024-01-27T15:00:09.144832+0000","last_deep_scrub":"29'123","last_deep_scrub_stamp":"2024-01-27T15:00:09.144832+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.144832+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:24:42.178813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.938257+0000","last_change":"2024-01-27T15:00:07.938281+0000","last_active":"2024-01-27T15:00:07.938257+0000","last_peered":"2024-01-27T15:00:07.938257+0000","last_clean":"2024-01-27T15:00:07.938257+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T15:00:07.938257+0000","last_undegraded":"2024-01-27T15:00:07.938257+0000","last_fullsized":"2024-01-27T15:00:07.938257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-01-27T15:00:07.938192+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-01-27T15:00:07.938192+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.938192+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:27.495513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'936","reported_seq":1909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.295938+0000","last_change":"2024-01-27T14:59:56.295979+0000","last_active":"2024-01-27T14:59:56.295938+0000","last_peered":"2024-01-27T14:59:56.295938+0000","last_clean":"2024-01-27T14:59:56.295938+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:56.295938+0000","last_undegraded":"2024-01-27T14:59:56.295938+0000","last_fullsized":"2024-01-27T14:59:56.295938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'936","last_scrub_stamp":"2024-01-27T14:59:56.295875+0000","last_deep_scrub":"29'936","last_deep_scrub_stamp":"2024-01-27T14:59:56.295875+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.295875+0000","objects_scrubbed":4,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:53:50.675856+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.129925+0000","last_change":"2024-01-27T15:00:07.129925+0000","last_active":"2024-01-27T15:00:07.129925+0000","last_peered":"2024-01-27T15:00:07.129925+0000","last_clean":"2024-01-27T15:00:07.129925+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T15:00:07.129925+0000","last_undegraded":"2024-01-27T15:00:07.129925+0000","last_fullsized":"2024-01-27T15:00:07.129925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'157","last_scrub_stamp":"2024-01-27T15:00:07.129834+0000","last_deep_scrub":"29'157","last_deep_scrub_stamp":"2024-01-27T15:00:07.129834+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.129834+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:05:37.883092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.168569+0000","last_change":"2024-01-27T14:59:58.168600+0000","last_active":"2024-01-27T14:59:58.168569+0000","last_peered":"2024-01-27T14:59:58.168569+0000","last_clean":"2024-01-27T14:59:58.168569+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:58.168569+0000","last_undegraded":"2024-01-27T14:59:58.168569+0000","last_fullsized":"2024-01-27T14:59:58.168569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T14:59:58.168477+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T14:59:58.168477+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.168477+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:49.579594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'480","reported_seq":531,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.010895+0000","last_change":"2024-01-27T15:00:07.010943+0000","last_active":"2024-01-27T15:00:07.010895+0000","last_peered":"2024-01-27T15:00:07.010895+0000","last_clean":"2024-01-27T15:00:07.010895+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T15:00:07.010895+0000","last_undegraded":"2024-01-27T15:00:07.010895+0000","last_fullsized":"2024-01-27T15:00:07.010895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'480","last_scrub_stamp":"2024-01-27T15:00:07.010804+0000","last_deep_scrub":"29'480","last_deep_scrub_stamp":"2024-01-27T15:00:07.010804+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.010804+0000","objects_scrubbed":2,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:09.366096+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:11.862379+0000","last_change":"2024-01-27T15:00:11.862406+0000","last_active":"2024-01-27T15:00:11.862379+0000","last_peered":"2024-01-27T15:00:11.862379+0000","last_clean":"2024-01-27T15:00:11.862379+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T15:00:11.862379+0000","last_undegraded":"2024-01-27T15:00:11.862379+0000","last_fullsized":"2024-01-27T15:00:11.862379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2024-01-27T15:00:11.862306+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2024-01-27T15:00:11.862306+0000","last_clean_scrub_stamp":"2024-01-27T15:00:11.862306+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:57:16.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.887487+0000","last_change":"2024-01-27T15:00:00.887530+0000","last_active":"2024-01-27T15:00:00.887487+0000","last_peered":"2024-01-27T15:00:00.887487+0000","last_clean":"2024-01-27T15:00:00.887487+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T15:00:00.887487+0000","last_undegraded":"2024-01-27T15:00:00.887487+0000","last_fullsized":"2024-01-27T15:00:00.887487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:00.887360+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:00.887360+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.887360+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:16:31.648233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'17","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.951893+0000","last_change":"2024-01-27T15:00:02.951925+0000","last_active":"2024-01-27T15:00:02.951893+0000","last_peered":"2024-01-27T15:00:02.951893+0000","last_clean":"2024-01-27T15:00:02.951893+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T15:00:02.951893+0000","last_undegraded":"2024-01-27T15:00:02.951893+0000","last_fullsized":"2024-01-27T15:00:02.951893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-01-27T15:00:02.951813+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-01-27T15:00:02.951813+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.951813+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:54:06.153021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.074075+0000","last_change":"2024-01-27T14:59:51.074105+0000","last_active":"2024-01-27T14:59:51.074075+0000","last_peered":"2024-01-27T14:59:51.074075+0000","last_clean":"2024-01-27T14:59:51.074075+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:59:51.074075+0000","last_undegraded":"2024-01-27T14:59:51.074075+0000","last_fullsized":"2024-01-27T14:59:51.074075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.074018+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:28:32.754624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.790227+0000","last_change":"2024-01-27T14:31:57.751268+0000","last_active":"2024-01-27T14:59:10.790227+0000","last_peered":"2024-01-27T14:59:10.790227+0000","last_clean":"2024-01-27T14:59:10.790227+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T14:59:10.790227+0000","last_undegraded":"2024-01-27T14:59:10.790227+0000","last_fullsized":"2024-01-27T14:59:10.790227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.090252+0000","last_change":"2024-01-27T14:59:53.090272+0000","last_active":"2024-01-27T14:59:53.090252+0000","last_peered":"2024-01-27T14:59:53.090252+0000","last_clean":"2024-01-27T14:59:53.090252+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:53.090252+0000","last_undegraded":"2024-01-27T14:59:53.090252+0000","last_fullsized":"2024-01-27T14:59:53.090252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.090187+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:08:50.389343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'13","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.242232+0000","last_change":"2024-01-27T14:59:56.242273+0000","last_active":"2024-01-27T14:59:56.242232+0000","last_peered":"2024-01-27T14:59:56.242232+0000","last_clean":"2024-01-27T14:59:56.242232+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:56.242232+0000","last_undegraded":"2024-01-27T14:59:56.242232+0000","last_fullsized":"2024-01-27T14:59:56.242232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-01-27T14:59:56.242158+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-01-27T14:59:56.242158+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.242158+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:58:50.907940+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.887151+0000","last_change":"2024-01-27T15:00:00.887151+0000","last_active":"2024-01-27T15:00:00.887151+0000","last_peered":"2024-01-27T15:00:00.887151+0000","last_clean":"2024-01-27T15:00:00.887151+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T15:00:00.887151+0000","last_undegraded":"2024-01-27T15:00:00.887151+0000","last_fullsized":"2024-01-27T15:00:00.887151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'145","last_scrub_stamp":"2024-01-27T15:00:00.887064+0000","last_deep_scrub":"29'145","last_deep_scrub_stamp":"2024-01-27T15:00:00.887064+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.887064+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:16.892935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.497345+0000","last_change":"2024-01-27T15:00:03.497366+0000","last_active":"2024-01-27T15:00:03.497345+0000","last_peered":"2024-01-27T15:00:03.497345+0000","last_clean":"2024-01-27T15:00:03.497345+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T15:00:03.497345+0000","last_undegraded":"2024-01-27T15:00:03.497345+0000","last_fullsized":"2024-01-27T15:00:03.497345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:03.497277+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:03.497277+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.497277+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:29.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.938085+0000","last_change":"2024-01-27T14:59:59.938111+0000","last_active":"2024-01-27T14:59:59.938085+0000","last_peered":"2024-01-27T14:59:59.938085+0000","last_clean":"2024-01-27T14:59:59.938085+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:59.938085+0000","last_undegraded":"2024-01-27T14:59:59.938085+0000","last_fullsized":"2024-01-27T14:59:59.938085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T14:59:59.938023+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T14:59:59.938023+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.938023+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:42.550408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":222,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.895420+0000","last_change":"2024-01-27T15:00:09.895449+0000","last_active":"2024-01-27T15:00:09.895420+0000","last_peered":"2024-01-27T15:00:09.895420+0000","last_clean":"2024-01-27T15:00:09.895420+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T15:00:09.895420+0000","last_undegraded":"2024-01-27T15:00:09.895420+0000","last_fullsized":"2024-01-27T15:00:09.895420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'183","last_scrub_stamp":"2024-01-27T15:00:09.895348+0000","last_deep_scrub":"29'183","last_deep_scrub_stamp":"2024-01-27T15:00:09.895348+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.895348+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:47:10.698566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.440228+0000","last_change":"2024-01-27T15:00:01.440250+0000","last_active":"2024-01-27T15:00:01.440228+0000","last_peered":"2024-01-27T15:00:01.440228+0000","last_clean":"2024-01-27T15:00:01.440228+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T15:00:01.440228+0000","last_undegraded":"2024-01-27T15:00:01.440228+0000","last_fullsized":"2024-01-27T15:00:01.440228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:01.440158+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:01.440158+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.440158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:45:51.230781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.903470+0000","last_change":"2024-01-27T14:59:55.903514+0000","last_active":"2024-01-27T14:59:55.903470+0000","last_peered":"2024-01-27T14:59:55.903470+0000","last_clean":"2024-01-27T14:59:55.903470+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:55.903470+0000","last_undegraded":"2024-01-27T14:59:55.903470+0000","last_fullsized":"2024-01-27T14:59:55.903470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-01-27T14:59:55.903368+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-01-27T14:59:55.903368+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.903368+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:18.467083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:13.883460+0000","last_change":"2024-01-27T15:00:13.883508+0000","last_active":"2024-01-27T15:00:13.883460+0000","last_peered":"2024-01-27T15:00:13.883460+0000","last_clean":"2024-01-27T15:00:13.883460+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T15:00:13.883460+0000","last_undegraded":"2024-01-27T15:00:13.883460+0000","last_fullsized":"2024-01-27T15:00:13.883460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2024-01-27T15:00:13.883344+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2024-01-27T15:00:13.883344+0000","last_clean_scrub_stamp":"2024-01-27T15:00:13.883344+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:30:59.096087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.835476+0000","last_change":"2024-01-27T14:59:58.835499+0000","last_active":"2024-01-27T14:59:58.835476+0000","last_peered":"2024-01-27T14:59:58.835476+0000","last_clean":"2024-01-27T14:59:58.835476+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:58.835476+0000","last_undegraded":"2024-01-27T14:59:58.835476+0000","last_fullsized":"2024-01-27T14:59:58.835476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-01-27T14:59:58.835403+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-01-27T14:59:58.835403+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.835403+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:42:03.270535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.482452+0000","last_change":"2024-01-27T14:59:53.482502+0000","last_active":"2024-01-27T14:59:53.482452+0000","last_peered":"2024-01-27T14:59:53.482452+0000","last_clean":"2024-01-27T14:59:53.482452+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:53.482452+0000","last_undegraded":"2024-01-27T14:59:53.482452+0000","last_fullsized":"2024-01-27T14:59:53.482452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.482327+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:48.182635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.087921+0000","last_change":"2024-01-27T14:59:58.087921+0000","last_active":"2024-01-27T14:59:58.087921+0000","last_peered":"2024-01-27T14:59:58.087921+0000","last_clean":"2024-01-27T14:59:58.087921+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:58.087921+0000","last_undegraded":"2024-01-27T14:59:58.087921+0000","last_fullsized":"2024-01-27T14:59:58.087921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'164","last_scrub_stamp":"2024-01-27T14:59:58.087843+0000","last_deep_scrub":"29'164","last_deep_scrub_stamp":"2024-01-27T14:59:58.087843+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.087843+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:39.234454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.085858+0000","last_change":"2024-01-27T14:59:56.085901+0000","last_active":"2024-01-27T14:59:56.085858+0000","last_peered":"2024-01-27T14:59:56.085858+0000","last_clean":"2024-01-27T14:59:56.085858+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:56.085858+0000","last_undegraded":"2024-01-27T14:59:56.085858+0000","last_fullsized":"2024-01-27T14:59:56.085858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T14:59:56.085771+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T14:59:56.085771+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.085771+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:19.123573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'29","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.859688+0000","last_change":"2024-01-27T14:59:56.859736+0000","last_active":"2024-01-27T14:59:56.859688+0000","last_peered":"2024-01-27T14:59:56.859688+0000","last_clean":"2024-01-27T14:59:56.859688+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:56.859688+0000","last_undegraded":"2024-01-27T14:59:56.859688+0000","last_fullsized":"2024-01-27T14:59:56.859688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T14:59:56.859615+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T14:59:56.859615+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.859615+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:06:09.514907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:10.883059+0000","last_change":"2024-01-27T15:00:10.883102+0000","last_active":"2024-01-27T15:00:10.883059+0000","last_peered":"2024-01-27T15:00:10.883059+0000","last_clean":"2024-01-27T15:00:10.883059+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T15:00:10.883059+0000","last_undegraded":"2024-01-27T15:00:10.883059+0000","last_fullsized":"2024-01-27T15:00:10.883059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2024-01-27T15:00:10.882939+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2024-01-27T15:00:10.882939+0000","last_clean_scrub_stamp":"2024-01-27T15:00:10.882939+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:22:40.860403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.075077+0000","last_change":"2024-01-27T14:59:53.075077+0000","last_active":"2024-01-27T14:59:53.075077+0000","last_peered":"2024-01-27T14:59:53.075077+0000","last_clean":"2024-01-27T14:59:53.075077+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:53.075077+0000","last_undegraded":"2024-01-27T14:59:53.075077+0000","last_fullsized":"2024-01-27T14:59:53.075077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.074985+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:38:41.272079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.428768+0000","last_change":"2024-01-27T14:59:56.428803+0000","last_active":"2024-01-27T14:59:56.428768+0000","last_peered":"2024-01-27T14:59:56.428768+0000","last_clean":"2024-01-27T14:59:56.428768+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:56.428768+0000","last_undegraded":"2024-01-27T14:59:56.428768+0000","last_fullsized":"2024-01-27T14:59:56.428768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-01-27T14:59:56.428693+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-01-27T14:59:56.428693+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.428693+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:12.434563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":157,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:12.911258+0000","last_change":"2024-01-27T15:00:12.911281+0000","last_active":"2024-01-27T15:00:12.911258+0000","last_peered":"2024-01-27T15:00:12.911258+0000","last_clean":"2024-01-27T15:00:12.911258+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T15:00:12.911258+0000","last_undegraded":"2024-01-27T15:00:12.911258+0000","last_fullsized":"2024-01-27T15:00:12.911258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-01-27T15:00:12.911176+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-01-27T15:00:12.911176+0000","last_clean_scrub_stamp":"2024-01-27T15:00:12.911176+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:03:55.285890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:12.925777+0000","last_change":"2024-01-27T15:00:12.925816+0000","last_active":"2024-01-27T15:00:12.925777+0000","last_peered":"2024-01-27T15:00:12.925777+0000","last_clean":"2024-01-27T15:00:12.925777+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T15:00:12.925777+0000","last_undegraded":"2024-01-27T15:00:12.925777+0000","last_fullsized":"2024-01-27T15:00:12.925777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T15:00:12.925687+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T15:00:12.925687+0000","last_clean_scrub_stamp":"2024-01-27T15:00:12.925687+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:09.364615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.976645+0000","last_change":"2024-01-27T15:00:04.976672+0000","last_active":"2024-01-27T15:00:04.976645+0000","last_peered":"2024-01-27T15:00:04.976645+0000","last_clean":"2024-01-27T15:00:04.976645+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T15:00:04.976645+0000","last_undegraded":"2024-01-27T15:00:04.976645+0000","last_fullsized":"2024-01-27T15:00:04.976645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-01-27T15:00:04.976585+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-01-27T15:00:04.976585+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.976585+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:08:04.738934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.114571+0000","last_change":"2024-01-27T15:00:06.114594+0000","last_active":"2024-01-27T15:00:06.114571+0000","last_peered":"2024-01-27T15:00:06.114571+0000","last_clean":"2024-01-27T15:00:06.114571+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T15:00:06.114571+0000","last_undegraded":"2024-01-27T15:00:06.114571+0000","last_fullsized":"2024-01-27T15:00:06.114571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'108","last_scrub_stamp":"2024-01-27T15:00:06.114507+0000","last_deep_scrub":"29'108","last_deep_scrub_stamp":"2024-01-27T15:00:06.114507+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.114507+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:04:35.642102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.133029+0000","last_change":"2024-01-27T15:00:00.133051+0000","last_active":"2024-01-27T15:00:00.133029+0000","last_peered":"2024-01-27T15:00:00.133029+0000","last_clean":"2024-01-27T15:00:00.133029+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T15:00:00.133029+0000","last_undegraded":"2024-01-27T15:00:00.133029+0000","last_fullsized":"2024-01-27T15:00:00.133029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-01-27T15:00:00.132961+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-01-27T15:00:00.132961+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.132961+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:36:10.877935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'266","reported_seq":314,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.252051+0000","last_change":"2024-01-27T14:59:57.252079+0000","last_active":"2024-01-27T14:59:57.252051+0000","last_peered":"2024-01-27T14:59:57.252051+0000","last_clean":"2024-01-27T14:59:57.252051+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:57.252051+0000","last_undegraded":"2024-01-27T14:59:57.252051+0000","last_fullsized":"2024-01-27T14:59:57.252051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'266","last_scrub_stamp":"2024-01-27T14:59:57.251999+0000","last_deep_scrub":"29'266","last_deep_scrub_stamp":"2024-01-27T14:59:57.251999+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.251999+0000","objects_scrubbed":7,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:10:03.041865+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.788182+0000","last_change":"2024-01-27T15:00:06.788206+0000","last_active":"2024-01-27T15:00:06.788182+0000","last_peered":"2024-01-27T15:00:06.788182+0000","last_clean":"2024-01-27T15:00:06.788182+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T15:00:06.788182+0000","last_undegraded":"2024-01-27T15:00:06.788182+0000","last_fullsized":"2024-01-27T15:00:06.788182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2024-01-27T15:00:06.788113+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2024-01-27T15:00:06.788113+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.788113+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:29.825915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.454017+0000","last_change":"2024-01-27T15:00:04.454040+0000","last_active":"2024-01-27T15:00:04.454017+0000","last_peered":"2024-01-27T15:00:04.454017+0000","last_clean":"2024-01-27T15:00:04.454017+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T15:00:04.454017+0000","last_undegraded":"2024-01-27T15:00:04.454017+0000","last_fullsized":"2024-01-27T15:00:04.454017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:04.453937+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:04.453937+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.453937+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:40:21.637483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":882,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.841211+0000","last_change":"2024-01-27T14:59:51.841211+0000","last_active":"2024-01-27T14:59:51.841211+0000","last_peered":"2024-01-27T14:59:51.841211+0000","last_clean":"2024-01-27T14:59:51.841211+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:51.841211+0000","last_undegraded":"2024-01-27T14:59:51.841211+0000","last_fullsized":"2024-01-27T14:59:51.841211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'834","last_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_deep_scrub":"29'834","last_deep_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.841116+0000","objects_scrubbed":6,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:32.987727+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.769421+0000","last_change":"2024-01-27T15:00:07.769445+0000","last_active":"2024-01-27T15:00:07.769421+0000","last_peered":"2024-01-27T15:00:07.769421+0000","last_clean":"2024-01-27T15:00:07.769421+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T15:00:07.769421+0000","last_undegraded":"2024-01-27T15:00:07.769421+0000","last_fullsized":"2024-01-27T15:00:07.769421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'138","last_scrub_stamp":"2024-01-27T15:00:07.769342+0000","last_deep_scrub":"29'138","last_deep_scrub_stamp":"2024-01-27T15:00:07.769342+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.769342+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:24:40.803323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.135414+0000","last_change":"2024-01-27T14:59:55.135414+0000","last_active":"2024-01-27T14:59:55.135414+0000","last_peered":"2024-01-27T14:59:55.135414+0000","last_clean":"2024-01-27T14:59:55.135414+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:55.135414+0000","last_undegraded":"2024-01-27T14:59:55.135414+0000","last_fullsized":"2024-01-27T14:59:55.135414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:55.135333+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:55.135333+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.135333+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:16:42.700238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'632","reported_seq":679,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.250111+0000","last_change":"2024-01-27T14:59:58.250138+0000","last_active":"2024-01-27T14:59:58.250111+0000","last_peered":"2024-01-27T14:59:58.250111+0000","last_clean":"2024-01-27T14:59:58.250111+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:58.250111+0000","last_undegraded":"2024-01-27T14:59:58.250111+0000","last_fullsized":"2024-01-27T14:59:58.250111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'632","last_scrub_stamp":"2024-01-27T14:59:58.250050+0000","last_deep_scrub":"29'632","last_deep_scrub_stamp":"2024-01-27T14:59:58.250050+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.250050+0000","objects_scrubbed":4,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:15:28.700192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.837966+0000","last_change":"2024-01-27T15:00:01.837989+0000","last_active":"2024-01-27T15:00:01.837966+0000","last_peered":"2024-01-27T15:00:01.837966+0000","last_clean":"2024-01-27T15:00:01.837966+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T15:00:01.837966+0000","last_undegraded":"2024-01-27T15:00:01.837966+0000","last_fullsized":"2024-01-27T15:00:01.837966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'166","last_scrub_stamp":"2024-01-27T15:00:01.837888+0000","last_deep_scrub":"29'166","last_deep_scrub_stamp":"2024-01-27T15:00:01.837888+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.837888+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:23:47.540270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.938263+0000","last_change":"2024-01-27T15:00:01.938285+0000","last_active":"2024-01-27T15:00:01.938263+0000","last_peered":"2024-01-27T15:00:01.938263+0000","last_clean":"2024-01-27T15:00:01.938263+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T15:00:01.938263+0000","last_undegraded":"2024-01-27T15:00:01.938263+0000","last_fullsized":"2024-01-27T15:00:01.938263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T15:00:01.938193+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T15:00:01.938193+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.938193+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:27.756300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.476249+0000","last_change":"2024-01-27T14:59:55.476278+0000","last_active":"2024-01-27T14:59:55.476249+0000","last_peered":"2024-01-27T14:59:55.476249+0000","last_clean":"2024-01-27T14:59:55.476249+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:55.476249+0000","last_undegraded":"2024-01-27T14:59:55.476249+0000","last_fullsized":"2024-01-27T14:59:55.476249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-01-27T14:59:55.476186+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-01-27T14:59:55.476186+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.476186+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:01:30.301012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":165,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.278233+0000","last_change":"2024-01-27T15:00:03.278272+0000","last_active":"2024-01-27T15:00:03.278233+0000","last_peered":"2024-01-27T15:00:03.278233+0000","last_clean":"2024-01-27T15:00:03.278233+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T15:00:03.278233+0000","last_undegraded":"2024-01-27T15:00:03.278233+0000","last_fullsized":"2024-01-27T15:00:03.278233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'126","last_scrub_stamp":"2024-01-27T15:00:03.278140+0000","last_deep_scrub":"29'126","last_deep_scrub_stamp":"2024-01-27T15:00:03.278140+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.278140+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:51:09.051410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.817209+0000","last_change":"2024-01-27T14:59:52.817230+0000","last_active":"2024-01-27T14:59:52.817209+0000","last_peered":"2024-01-27T14:59:52.817209+0000","last_clean":"2024-01-27T14:59:52.817209+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:52.817209+0000","last_undegraded":"2024-01-27T14:59:52.817209+0000","last_fullsized":"2024-01-27T14:59:52.817209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.817143+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:28:29.310432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.031357+0000","last_change":"2024-01-27T14:59:52.031381+0000","last_active":"2024-01-27T14:59:52.031357+0000","last_peered":"2024-01-27T14:59:52.031357+0000","last_clean":"2024-01-27T14:59:52.031357+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:52.031357+0000","last_undegraded":"2024-01-27T14:59:52.031357+0000","last_fullsized":"2024-01-27T14:59:52.031357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.031300+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:12.849424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.776675+0000","last_change":"2024-01-27T15:00:06.776714+0000","last_active":"2024-01-27T15:00:06.776675+0000","last_peered":"2024-01-27T15:00:06.776675+0000","last_clean":"2024-01-27T15:00:06.776675+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T15:00:06.776675+0000","last_undegraded":"2024-01-27T15:00:06.776675+0000","last_fullsized":"2024-01-27T15:00:06.776675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'149","last_scrub_stamp":"2024-01-27T15:00:06.776575+0000","last_deep_scrub":"29'149","last_deep_scrub_stamp":"2024-01-27T15:00:06.776575+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.776575+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:04:32.195594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.765112+0000","last_change":"2024-01-27T15:00:08.765155+0000","last_active":"2024-01-27T15:00:08.765112+0000","last_peered":"2024-01-27T15:00:08.765112+0000","last_clean":"2024-01-27T15:00:08.765112+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T15:00:08.765112+0000","last_undegraded":"2024-01-27T15:00:08.765112+0000","last_fullsized":"2024-01-27T15:00:08.765112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'137","last_scrub_stamp":"2024-01-27T15:00:08.765030+0000","last_deep_scrub":"29'137","last_deep_scrub_stamp":"2024-01-27T15:00:08.765030+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.765030+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:27:58.586393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.884730+0000","last_change":"2024-01-27T14:59:58.884751+0000","last_active":"2024-01-27T14:59:58.884730+0000","last_peered":"2024-01-27T14:59:58.884730+0000","last_clean":"2024-01-27T14:59:58.884730+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:58.884730+0000","last_undegraded":"2024-01-27T14:59:58.884730+0000","last_fullsized":"2024-01-27T14:59:58.884730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T14:59:58.884663+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T14:59:58.884663+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.884663+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:34:56.905840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.979956+0000","last_change":"2024-01-27T15:00:03.979983+0000","last_active":"2024-01-27T15:00:03.979956+0000","last_peered":"2024-01-27T15:00:03.979956+0000","last_clean":"2024-01-27T15:00:03.979956+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T15:00:03.979956+0000","last_undegraded":"2024-01-27T15:00:03.979956+0000","last_fullsized":"2024-01-27T15:00:03.979956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T15:00:03.979881+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T15:00:03.979881+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.979881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:52.883472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:10.948340+0000","last_change":"2024-01-27T14:31:57.736192+0000","last_active":"2024-01-27T14:59:10.948340+0000","last_peered":"2024-01-27T14:59:10.948340+0000","last_clean":"2024-01-27T14:59:10.948340+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T14:59:10.948340+0000","last_undegraded":"2024-01-27T14:59:10.948340+0000","last_fullsized":"2024-01-27T14:59:10.948340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T14:31:56.457614+0000","last_clean_scrub_stamp":"2024-01-27T14:31:56.457614+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.910486+0000","last_change":"2024-01-27T15:00:05.910506+0000","last_active":"2024-01-27T15:00:05.910486+0000","last_peered":"2024-01-27T15:00:05.910486+0000","last_clean":"2024-01-27T15:00:05.910486+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T15:00:05.910486+0000","last_undegraded":"2024-01-27T15:00:05.910486+0000","last_fullsized":"2024-01-27T15:00:05.910486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T15:00:05.910420+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T15:00:05.910420+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.910420+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:02:20.652286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.194043+0000","last_change":"2024-01-27T14:59:57.194068+0000","last_active":"2024-01-27T14:59:57.194043+0000","last_peered":"2024-01-27T14:59:57.194043+0000","last_clean":"2024-01-27T14:59:57.194043+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:57.194043+0000","last_undegraded":"2024-01-27T14:59:57.194043+0000","last_fullsized":"2024-01-27T14:59:57.194043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T14:59:57.193984+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T14:59:57.193984+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.193984+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:08:01.550419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'664","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.012278+0000","last_change":"2024-01-27T15:00:09.012314+0000","last_active":"2024-01-27T15:00:09.012278+0000","last_peered":"2024-01-27T15:00:09.012278+0000","last_clean":"2024-01-27T15:00:09.012278+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T15:00:09.012278+0000","last_undegraded":"2024-01-27T15:00:09.012278+0000","last_fullsized":"2024-01-27T15:00:09.012278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'664","last_scrub_stamp":"2024-01-27T15:00:09.012205+0000","last_deep_scrub":"29'664","last_deep_scrub_stamp":"2024-01-27T15:00:09.012205+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.012205+0000","objects_scrubbed":4,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:36.310699+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.765670+0000","last_change":"2024-01-27T15:00:03.765691+0000","last_active":"2024-01-27T15:00:03.765670+0000","last_peered":"2024-01-27T15:00:03.765670+0000","last_clean":"2024-01-27T15:00:03.765670+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T15:00:03.765670+0000","last_undegraded":"2024-01-27T15:00:03.765670+0000","last_fullsized":"2024-01-27T15:00:03.765670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:03.765611+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:03.765611+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.765611+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:52.673313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":133,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.725241+0000","last_change":"2024-01-27T15:00:04.725266+0000","last_active":"2024-01-27T15:00:04.725241+0000","last_peered":"2024-01-27T15:00:04.725241+0000","last_clean":"2024-01-27T15:00:04.725241+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T15:00:04.725241+0000","last_undegraded":"2024-01-27T15:00:04.725241+0000","last_fullsized":"2024-01-27T15:00:04.725241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'95","last_scrub_stamp":"2024-01-27T15:00:04.725161+0000","last_deep_scrub":"29'95","last_deep_scrub_stamp":"2024-01-27T15:00:04.725161+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.725161+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:04:34.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'690","reported_seq":738,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.914432+0000","last_change":"2024-01-27T14:59:58.914460+0000","last_active":"2024-01-27T14:59:58.914432+0000","last_peered":"2024-01-27T14:59:58.914432+0000","last_clean":"2024-01-27T14:59:58.914432+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:58.914432+0000","last_undegraded":"2024-01-27T14:59:58.914432+0000","last_fullsized":"2024-01-27T14:59:58.914432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'690","last_scrub_stamp":"2024-01-27T14:59:58.914363+0000","last_deep_scrub":"29'690","last_deep_scrub_stamp":"2024-01-27T14:59:58.914363+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.914363+0000","objects_scrubbed":3,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:20:57.873494+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.098443+0000","last_change":"2024-01-27T14:59:54.098480+0000","last_active":"2024-01-27T14:59:54.098443+0000","last_peered":"2024-01-27T14:59:54.098443+0000","last_clean":"2024-01-27T14:59:54.098443+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:54.098443+0000","last_undegraded":"2024-01-27T14:59:54.098443+0000","last_fullsized":"2024-01-27T14:59:54.098443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.098350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:00:06.958729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.318645+0000","last_change":"2024-01-27T15:00:04.318670+0000","last_active":"2024-01-27T15:00:04.318645+0000","last_peered":"2024-01-27T15:00:04.318645+0000","last_clean":"2024-01-27T15:00:04.318645+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T15:00:04.318645+0000","last_undegraded":"2024-01-27T15:00:04.318645+0000","last_fullsized":"2024-01-27T15:00:04.318645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'152","last_scrub_stamp":"2024-01-27T15:00:04.318565+0000","last_deep_scrub":"29'152","last_deep_scrub_stamp":"2024-01-27T15:00:04.318565+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.318565+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:33:07.684907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.799851+0000","last_change":"2024-01-27T14:59:57.799874+0000","last_active":"2024-01-27T14:59:57.799851+0000","last_peered":"2024-01-27T14:59:57.799851+0000","last_clean":"2024-01-27T14:59:57.799851+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:57.799851+0000","last_undegraded":"2024-01-27T14:59:57.799851+0000","last_fullsized":"2024-01-27T14:59:57.799851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-01-27T14:59:57.799762+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-01-27T14:59:57.799762+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.799762+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:52.500070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.269889+0000","last_change":"2024-01-27T14:59:59.269931+0000","last_active":"2024-01-27T14:59:59.269889+0000","last_peered":"2024-01-27T14:59:59.269889+0000","last_clean":"2024-01-27T14:59:59.269889+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:59.269889+0000","last_undegraded":"2024-01-27T14:59:59.269889+0000","last_fullsized":"2024-01-27T14:59:59.269889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-01-27T14:59:59.269814+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-01-27T14:59:59.269814+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.269814+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:34:42.923047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.059176+0000","last_change":"2024-01-27T14:59:59.059200+0000","last_active":"2024-01-27T14:59:59.059176+0000","last_peered":"2024-01-27T14:59:59.059176+0000","last_clean":"2024-01-27T14:59:59.059176+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:59.059176+0000","last_undegraded":"2024-01-27T14:59:59.059176+0000","last_fullsized":"2024-01-27T14:59:59.059176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-01-27T14:59:59.059097+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-01-27T14:59:59.059097+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.059097+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:02:13.800964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.821428+0000","last_change":"2024-01-27T14:59:53.821466+0000","last_active":"2024-01-27T14:59:53.821428+0000","last_peered":"2024-01-27T14:59:53.821428+0000","last_clean":"2024-01-27T14:59:53.821428+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:53.821428+0000","last_undegraded":"2024-01-27T14:59:53.821428+0000","last_fullsized":"2024-01-27T14:59:53.821428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.821328+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:58:09.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.178937+0000","last_change":"2024-01-27T15:00:04.178959+0000","last_active":"2024-01-27T15:00:04.178937+0000","last_peered":"2024-01-27T15:00:04.178937+0000","last_clean":"2024-01-27T15:00:04.178937+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T15:00:04.178937+0000","last_undegraded":"2024-01-27T15:00:04.178937+0000","last_fullsized":"2024-01-27T15:00:04.178937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T15:00:04.178830+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T15:00:04.178830+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.178830+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:59.135726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.175439+0000","last_change":"2024-01-27T15:00:01.175439+0000","last_active":"2024-01-27T15:00:01.175439+0000","last_peered":"2024-01-27T15:00:01.175439+0000","last_clean":"2024-01-27T15:00:01.175439+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T15:00:01.175439+0000","last_undegraded":"2024-01-27T15:00:01.175439+0000","last_fullsized":"2024-01-27T15:00:01.175439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:01.175324+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:01.175324+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.175324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:19:46.737006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.806394+0000","last_change":"2024-01-27T14:59:53.806394+0000","last_active":"2024-01-27T14:59:53.806394+0000","last_peered":"2024-01-27T14:59:53.806394+0000","last_clean":"2024-01-27T14:59:53.806394+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:53.806394+0000","last_undegraded":"2024-01-27T14:59:53.806394+0000","last_fullsized":"2024-01-27T14:59:53.806394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.806267+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:51.580529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.922845+0000","last_change":"2024-01-27T15:00:04.922883+0000","last_active":"2024-01-27T15:00:04.922845+0000","last_peered":"2024-01-27T15:00:04.922845+0000","last_clean":"2024-01-27T15:00:04.922845+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T15:00:04.922845+0000","last_undegraded":"2024-01-27T15:00:04.922845+0000","last_fullsized":"2024-01-27T15:00:04.922845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:04.922717+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:04.922717+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.922717+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:51:19.462480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.038151+0000","last_change":"2024-01-27T14:59:57.038151+0000","last_active":"2024-01-27T14:59:57.038151+0000","last_peered":"2024-01-27T14:59:57.038151+0000","last_clean":"2024-01-27T14:59:57.038151+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:57.038151+0000","last_undegraded":"2024-01-27T14:59:57.038151+0000","last_fullsized":"2024-01-27T14:59:57.038151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:57.038064+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:57.038064+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.038064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:18:08.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.953847+0000","last_change":"2024-01-27T15:00:03.953869+0000","last_active":"2024-01-27T15:00:03.953847+0000","last_peered":"2024-01-27T15:00:03.953847+0000","last_clean":"2024-01-27T15:00:03.953847+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T15:00:03.953847+0000","last_undegraded":"2024-01-27T15:00:03.953847+0000","last_fullsized":"2024-01-27T15:00:03.953847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-01-27T15:00:03.953766+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-01-27T15:00:03.953766+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.953766+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:18:15.127188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.062856+0000","last_change":"2024-01-27T14:59:57.062881+0000","last_active":"2024-01-27T14:59:57.062856+0000","last_peered":"2024-01-27T14:59:57.062856+0000","last_clean":"2024-01-27T14:59:57.062856+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:57.062856+0000","last_undegraded":"2024-01-27T14:59:57.062856+0000","last_fullsized":"2024-01-27T14:59:57.062856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:57.062797+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:57.062797+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.062797+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:33:39.085492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.866610+0000","last_change":"2024-01-27T14:59:59.866630+0000","last_active":"2024-01-27T14:59:59.866610+0000","last_peered":"2024-01-27T14:59:59.866610+0000","last_clean":"2024-01-27T14:59:59.866610+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:59.866610+0000","last_undegraded":"2024-01-27T14:59:59.866610+0000","last_fullsized":"2024-01-27T14:59:59.866610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T14:59:59.866553+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T14:59:59.866553+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.866553+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:42.619239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.468290+0000","last_change":"2024-01-27T15:00:02.468311+0000","last_active":"2024-01-27T15:00:02.468290+0000","last_peered":"2024-01-27T15:00:02.468290+0000","last_clean":"2024-01-27T15:00:02.468290+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T15:00:02.468290+0000","last_undegraded":"2024-01-27T15:00:02.468290+0000","last_fullsized":"2024-01-27T15:00:02.468290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-01-27T15:00:02.468220+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-01-27T15:00:02.468220+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.468220+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:29.373068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.995199+0000","last_change":"2024-01-27T15:00:09.995240+0000","last_active":"2024-01-27T15:00:09.995199+0000","last_peered":"2024-01-27T15:00:09.995199+0000","last_clean":"2024-01-27T15:00:09.995199+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T15:00:09.995199+0000","last_undegraded":"2024-01-27T15:00:09.995199+0000","last_fullsized":"2024-01-27T15:00:09.995199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:09.995122+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:09.995122+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.995122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:20:53.284314+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.237155+0000","last_change":"2024-01-27T15:00:01.237177+0000","last_active":"2024-01-27T15:00:01.237155+0000","last_peered":"2024-01-27T15:00:01.237155+0000","last_clean":"2024-01-27T15:00:01.237155+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T15:00:01.237155+0000","last_undegraded":"2024-01-27T15:00:01.237155+0000","last_fullsized":"2024-01-27T15:00:01.237155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T15:00:01.237076+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T15:00:01.237076+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.237076+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:32:07.949509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:11.917211+0000","last_change":"2024-01-27T15:00:11.917240+0000","last_active":"2024-01-27T15:00:11.917211+0000","last_peered":"2024-01-27T15:00:11.917211+0000","last_clean":"2024-01-27T15:00:11.917211+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T15:00:11.917211+0000","last_undegraded":"2024-01-27T15:00:11.917211+0000","last_fullsized":"2024-01-27T15:00:11.917211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-01-27T15:00:11.917122+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-01-27T15:00:11.917122+0000","last_clean_scrub_stamp":"2024-01-27T15:00:11.917122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:16.440681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.086820+0000","last_change":"2024-01-27T14:59:58.086859+0000","last_active":"2024-01-27T14:59:58.086820+0000","last_peered":"2024-01-27T14:59:58.086820+0000","last_clean":"2024-01-27T14:59:58.086820+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:58.086820+0000","last_undegraded":"2024-01-27T14:59:58.086820+0000","last_fullsized":"2024-01-27T14:59:58.086820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-01-27T14:59:58.086712+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-01-27T14:59:58.086712+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.086712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:33:18.128270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.874907+0000","last_change":"2024-01-27T14:59:55.874930+0000","last_active":"2024-01-27T14:59:55.874907+0000","last_peered":"2024-01-27T14:59:55.874907+0000","last_clean":"2024-01-27T14:59:55.874907+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:55.874907+0000","last_undegraded":"2024-01-27T14:59:55.874907+0000","last_fullsized":"2024-01-27T14:59:55.874907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-01-27T14:59:55.874845+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-01-27T14:59:55.874845+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.874845+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:51:26.658352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.185919+0000","last_change":"2024-01-27T15:00:03.185957+0000","last_active":"2024-01-27T15:00:03.185919+0000","last_peered":"2024-01-27T15:00:03.185919+0000","last_clean":"2024-01-27T15:00:03.185919+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T15:00:03.185919+0000","last_undegraded":"2024-01-27T15:00:03.185919+0000","last_fullsized":"2024-01-27T15:00:03.185919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T15:00:03.185824+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T15:00:03.185824+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.185824+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:17:07.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.148824+0000","last_change":"2024-01-27T14:59:59.148863+0000","last_active":"2024-01-27T14:59:59.148824+0000","last_peered":"2024-01-27T14:59:59.148824+0000","last_clean":"2024-01-27T14:59:59.148824+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:59.148824+0000","last_undegraded":"2024-01-27T14:59:59.148824+0000","last_fullsized":"2024-01-27T14:59:59.148824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T14:59:59.148733+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T14:59:59.148733+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.148733+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:04.323273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.415134+0000","last_change":"2024-01-27T14:59:59.415156+0000","last_active":"2024-01-27T14:59:59.415134+0000","last_peered":"2024-01-27T14:59:59.415134+0000","last_clean":"2024-01-27T14:59:59.415134+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:59.415134+0000","last_undegraded":"2024-01-27T14:59:59.415134+0000","last_fullsized":"2024-01-27T14:59:59.415134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-01-27T14:59:59.415062+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-01-27T14:59:59.415062+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.415062+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:15.567607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:50.525972+0000","last_change":"2024-01-27T14:59:50.526009+0000","last_active":"2024-01-27T14:59:50.525972+0000","last_peered":"2024-01-27T14:59:50.525972+0000","last_clean":"2024-01-27T14:59:50.525972+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:50.525972+0000","last_undegraded":"2024-01-27T14:59:50.525972+0000","last_fullsized":"2024-01-27T14:59:50.525972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_clean_scrub_stamp":"2024-01-27T14:59:50.525903+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:25.998821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.447013+0000","last_change":"2024-01-27T14:59:57.447041+0000","last_active":"2024-01-27T14:59:57.447013+0000","last_peered":"2024-01-27T14:59:57.447013+0000","last_clean":"2024-01-27T14:59:57.447013+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:57.447013+0000","last_undegraded":"2024-01-27T14:59:57.447013+0000","last_fullsized":"2024-01-27T14:59:57.447013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-01-27T14:59:57.446941+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-01-27T14:59:57.446941+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.446941+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:32:22.552837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.104686+0000","last_change":"2024-01-27T14:59:55.104708+0000","last_active":"2024-01-27T14:59:55.104686+0000","last_peered":"2024-01-27T14:59:55.104686+0000","last_clean":"2024-01-27T14:59:55.104686+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:55.104686+0000","last_undegraded":"2024-01-27T14:59:55.104686+0000","last_fullsized":"2024-01-27T14:59:55.104686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T14:59:55.104623+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T14:59:55.104623+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.104623+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:53:49.484603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.925932+0000","last_change":"2024-01-27T15:00:06.925953+0000","last_active":"2024-01-27T15:00:06.925932+0000","last_peered":"2024-01-27T15:00:06.925932+0000","last_clean":"2024-01-27T15:00:06.925932+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T15:00:06.925932+0000","last_undegraded":"2024-01-27T15:00:06.925932+0000","last_fullsized":"2024-01-27T15:00:06.925932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T15:00:06.925870+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T15:00:06.925870+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.925870+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:10:55.699665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.430001+0000","last_change":"2024-01-27T15:00:05.430045+0000","last_active":"2024-01-27T15:00:05.430001+0000","last_peered":"2024-01-27T15:00:05.430001+0000","last_clean":"2024-01-27T15:00:05.430001+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T15:00:05.430001+0000","last_undegraded":"2024-01-27T15:00:05.430001+0000","last_fullsized":"2024-01-27T15:00:05.430001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:05.429893+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:05.429893+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.429893+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:30:34.240966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.804651+0000","last_change":"2024-01-27T14:59:55.804689+0000","last_active":"2024-01-27T14:59:55.804651+0000","last_peered":"2024-01-27T14:59:55.804651+0000","last_clean":"2024-01-27T14:59:55.804651+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:55.804651+0000","last_undegraded":"2024-01-27T14:59:55.804651+0000","last_fullsized":"2024-01-27T14:59:55.804651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:55.804548+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:55.804548+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.804548+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:51:01.577818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.277903+0000","last_change":"2024-01-27T15:00:06.277925+0000","last_active":"2024-01-27T15:00:06.277903+0000","last_peered":"2024-01-27T15:00:06.277903+0000","last_clean":"2024-01-27T15:00:06.277903+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T15:00:06.277903+0000","last_undegraded":"2024-01-27T15:00:06.277903+0000","last_fullsized":"2024-01-27T15:00:06.277903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:06.277838+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:06.277838+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.277838+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:42:10.712970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.781303+0000","last_change":"2024-01-27T14:59:54.781325+0000","last_active":"2024-01-27T14:59:54.781303+0000","last_peered":"2024-01-27T14:59:54.781303+0000","last_clean":"2024-01-27T14:59:54.781303+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:54.781303+0000","last_undegraded":"2024-01-27T14:59:54.781303+0000","last_fullsized":"2024-01-27T14:59:54.781303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2024-01-27T14:59:54.781231+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2024-01-27T14:59:54.781231+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.781231+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:07:39.307178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.845974+0000","last_change":"2024-01-27T14:59:54.846010+0000","last_active":"2024-01-27T14:59:54.845974+0000","last_peered":"2024-01-27T14:59:54.845974+0000","last_clean":"2024-01-27T14:59:54.845974+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:54.845974+0000","last_undegraded":"2024-01-27T14:59:54.845974+0000","last_fullsized":"2024-01-27T14:59:54.845974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-01-27T14:59:54.845907+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-01-27T14:59:54.845907+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.845907+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:41:59.281038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.906228+0000","last_change":"2024-01-27T15:00:08.906264+0000","last_active":"2024-01-27T15:00:08.906228+0000","last_peered":"2024-01-27T15:00:08.906228+0000","last_clean":"2024-01-27T15:00:08.906228+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T15:00:08.906228+0000","last_undegraded":"2024-01-27T15:00:08.906228+0000","last_fullsized":"2024-01-27T15:00:08.906228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:08.906157+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:08.906157+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.906157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:23:59.323505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.417105+0000","last_change":"2024-01-27T14:59:58.417127+0000","last_active":"2024-01-27T14:59:58.417105+0000","last_peered":"2024-01-27T14:59:58.417105+0000","last_clean":"2024-01-27T14:59:58.417105+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:58.417105+0000","last_undegraded":"2024-01-27T14:59:58.417105+0000","last_fullsized":"2024-01-27T14:59:58.417105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-01-27T14:59:58.417040+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-01-27T14:59:58.417040+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.417040+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:42:29.312782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8352,"ondisk_log_size":8352,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509789,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.58399999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.41699999999999998},"min":{"1min":0.32100000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60999999999999999},"last":0.441},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.434},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.23599999999999999},"max":{"1min":0.55900000000000005,"5min":0.626,"15min":0.80100000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60799999999999998,"5min":0.61299999999999999,"15min":0.61599999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.442,"15min":0.441},"min":{"1min":0.33000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.54000000000000004,"5min":0.64200000000000002,"15min":0.66100000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.44600000000000001,"5min":0.60499999999999998,"15min":0.76900000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.55800000000000005,"15min":0.621},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.46600000000000003,"5min":0.54000000000000004,"15min":0.59899999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Jan 27 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.441},"min":{"1min":0.29999999999999999,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52200000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509789,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75112,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94296728,"statfs":{"total":96636764160,"available":96559849472,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26100000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.439},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.58199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.27500000000000002,"15min":0.27000000000000002},"max":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.67100000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.64000000000000001},"last":0.503},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.42699999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.66500000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.65500000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61899999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.71999999999999997},"last":0.42299999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.56299999999999994,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.31},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.441,"15min":0.435},"min":{"1min":0.28100000000000003,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.73699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.45300000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509788,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.312,"15min":0.30599999999999999},"min":{"1min":0.19900000000000001,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.314},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.57499999999999996},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.313,"15min":0.316},"min":{"1min":0.22500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.35299999999999998},"min":{"1min":0.26500000000000001,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.68200000000000005},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.64800000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.27300000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.72499999999999998},"last":0.499}]},{"osd":4,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.40300000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.38500000000000001,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.79500000000000004},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.76000000000000001},"last":0.59199999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509788,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.28599999999999998,"15min":0.28999999999999998},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.375,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":0.58499999999999996,"15min":0.59699999999999998},"last":0.60699999999999998}]},{"osd":1,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.51400000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.42699999999999999,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":0.49399999999999999,"5min":0.60099999999999998,"15min":0.60699999999999998},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.313},"max":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.442,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.63400000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.65700000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54800000000000004,"5min":0.752,"15min":0.752},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Jan 27 14:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509788,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29699999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.51800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.191},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.432}]},{"osd":4,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.248},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.747},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.28999999999999998},"max":{"1min":0.628,"5min":0.872,"15min":0.872},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.70599999999999996},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Jan 27 14:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509788,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":0.45700000000000002,"5min":0.47699999999999998,"15min":0.53700000000000003},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.315},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.55000000000000004,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.61399999999999999},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.192,"15min":0.192},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.224},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.80700000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.63800000000000001,"15min":0.79500000000000004},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.40500000000000003}]},{"osd":6,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.68600000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.375}]},{"osd":7,"last update":"Sat Jan 27 14:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.497,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.442},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.70599999999999996},"last":0.503}]}]},{"osd":6,"up_from":14,"seq":60129542493,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.23699999999999999},"max":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.495}]},{"osd":1,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.438,"15min":0.42599999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.317,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41999999999999998,"15min":0.42499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.443,"15min":0.433},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.442}]},{"osd":3,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67400000000000004},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Jan 27 14:59:10 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.625},"last":0.36299999999999999}]},{"osd":7,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.65600000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.34000000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542494,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.501}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.51300000000000001}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.442},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.38200000000000001}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T15:00:16.616 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T15:00:16.616 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T15:00:16.617 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-27T14:31:56.457614+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=31, tm_sec=56, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T15:00:16.618 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-27T15:00:33.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:00:33.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:00:36.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T15:00:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.725+0000 7ff56b5c5640 1 Processor -- start 2024-01-27T15:00:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.725+0000 7ff56b5c5640 1 -- start start 2024-01-27T15:00:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.726+0000 7ff56b5c5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff564153980 0x7ff56415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.726+0000 7ff56b5c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff56406f0f0 0x7ff5640c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.726+0000 7ff56b5c5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56415cbd0 con 0x7ff56406b7d0 2024-01-27T15:00:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.726+0000 7ff56b5c5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640c3cd0 con 0x7ff564153980 2024-01-27T15:00:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.726+0000 7ff56b5c5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56415d190 con 0x7ff56406f0f0 2024-01-27T15:00:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.727+0000 7ff569361640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff564153980 0x7ff56415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.727+0000 7ff568b60640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff56406f0f0 0x7ff5640c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.727+0000 7ff568b60640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff56406f0f0 0x7ff5640c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43484/0 (socket says 172.21.15.46:43484) 2024-01-27T15:00:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.727+0000 7ff568b60640 1 -- 172.21.15.46:0/1429477537 learned_addr learned my addr 172.21.15.46:0/1429477537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:36.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.730+0000 7ff568b60640 1 -- 172.21.15.46:0/1429477537 >> v2:172.21.15.46:3300/0 conn(0x7ff564153980 msgr2=0x7ff56415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.730+0000 7ff568b60640 1 --2- 172.21.15.46:0/1429477537 >> v2:172.21.15.46:3300/0 conn(0x7ff564153980 0x7ff56415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.730+0000 7ff568b60640 1 -- 172.21.15.46:0/1429477537 >> v1:172.21.15.46:6789/0 conn(0x7ff56406b7d0 legacy=0x7ff5640c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.730+0000 7ff568b60640 1 -- 172.21.15.46:0/1429477537 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56415db60 con 0x7ff56406f0f0 2024-01-27T15:00:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.732+0000 7ff568b60640 1 --2- 172.21.15.46:0/1429477537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff5640c8fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff5640ca5f0 tx=0x7ff55802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f78f9cf48cd84c3f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:36.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.736+0000 7ff563fff640 1 -- 172.21.15.46:0/1429477537 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558030860 con 0x7ff56406f0f0 2024-01-27T15:00:36.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.736+0000 7ff563fff640 1 -- 172.21.15.46:0/1429477537 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580309c0 con 0x7ff56406f0f0 2024-01-27T15:00:36.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.736+0000 7ff563fff640 1 -- 172.21.15.46:0/1429477537 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558030d50 con 0x7ff56406f0f0 2024-01-27T15:00:36.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1429477537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 msgr2=0x7ff5640c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:36.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1429477537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff5640c8fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff5640ca5f0 tx=0x7ff55802b9a0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1429477537 shutdown_connections 2024-01-27T15:00:36.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1429477537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff5640c8fe0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1429477537 >> v2:172.21.15.46:3300/0 conn(0x7ff564153980 0x7ff56415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1429477537 >> 172.21.15.46:0/1429477537 conn(0x7ff564070f40 msgr2=0x7ff564071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:36.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1429477537 shutdown_connections 2024-01-27T15:00:36.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.737+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1429477537 wait complete. 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.738+0000 7ff56b5c5640 1 Processor -- start 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.738+0000 7ff56b5c5640 1 -- start start 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff56415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff564153980 0x7ff5641433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564144130 con 0x7ff56406b7d0 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641f2820 con 0x7ff56406f0f0 2024-01-27T15:00:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.739+0000 7ff56b5c5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff564143e50 con 0x7ff564153980 2024-01-27T15:00:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.740+0000 7ff569361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.740+0000 7ff568b60640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff56415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.740+0000 7ff569361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60452/0 (socket says 172.21.15.46:60452) 2024-01-27T15:00:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.740+0000 7ff569361640 1 -- 172.21.15.46:0/1392925692 learned_addr learned my addr 172.21.15.46:0/1392925692 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.740+0000 7ff569b62640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff564153980 0x7ff5641433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.743+0000 7ff569361640 1 -- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff564153980 msgr2=0x7ff5641433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.743+0000 7ff569361640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff564153980 0x7ff5641433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.743+0000 7ff569361640 1 -- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 msgr2=0x7ff56415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.743+0000 7ff569361640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff56415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.743+0000 7ff569361640 1 -- 172.21.15.46:0/1392925692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580094d0 con 0x7ff56406b7d0 2024-01-27T15:00:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.746+0000 7ff569361640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e9b0 tx=0x7ff55c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.749+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c009670 con 0x7ff56406b7d0 2024-01-27T15:00:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.749+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00c9a0 con 0x7ff56406b7d0 2024-01-27T15:00:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.749+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5641f2a70 con 0x7ff56406b7d0 2024-01-27T15:00:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.749+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cd50 con 0x7ff56406b7d0 2024-01-27T15:00:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.750+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5641f3030 con 0x7ff56406b7d0 2024-01-27T15:00:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.751+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5640742e0 con 0x7ff56406b7d0 2024-01-27T15:00:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.770+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff55c013470 con 0x7ff56406b7d0 2024-01-27T15:00:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.771+0000 7ff561ffb640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 0x7ff55006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.771+0000 7ff568b60640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 0x7ff55006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:36.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:36.771+0000 7ff568b60640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 0x7ff55006d3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff558036000 tx=0x7ff558008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:37.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.031+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7ff55c058cb0 con 0x7ff56406b7d0 2024-01-27T15:00:37.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.031+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff55c054ff0 con 0x7ff56406b7d0 2024-01-27T15:00:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.223+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 --> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5640c8040 con 0x7ff55006af20 2024-01-27T15:00:37.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.232+0000 7ff561ffb640 1 -- 172.21.15.46:0/1392925692 <== mgr.4111 v2:172.21.15.46:6800/82124097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371569 (secure 0 0 0) 0x7ff558030bb0 con 0x7ff55006af20 2024-01-27T15:00:37.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T15:00:37.240 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 msgr2=0x7ff55006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 0x7ff55006d3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff558036000 tx=0x7ff558008030 comp rx=0 tx=0).stop 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 msgr2=0x7ff5641510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e9b0 tx=0x7ff55c00ee70 comp rx=0 tx=0).stop 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 shutdown_connections 2024-01-27T15:00:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff55006af20 0x7ff55006d3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.235+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff56406f0f0 0x7ff56415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.236+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff564153980 0x7ff5641433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.236+0000 7ff56b5c5640 1 --2- 172.21.15.46:0/1392925692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56406b7d0 0x7ff5641510f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.236+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 >> 172.21.15.46:0/1392925692 conn(0x7ff564070f40 msgr2=0x7ff56406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.236+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 shutdown_connections 2024-01-27T15:00:37.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.236+0000 7ff56b5c5640 1 -- 172.21.15.46:0/1392925692 wait complete. 2024-01-27T15:00:37.249 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":897,"stamp":"2024-01-27T15:00:35.400137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40848979,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1040,"num_read_kb":1093,"num_write":12909,"num_write_kb":363833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15429,"ondisk_log_size":15429,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":476160,"kb_used_data":82432,"kb_used_omap":12,"kb_used_meta":393651,"kb_avail":754498560,"statfs":{"total":773094113280,"available":772606525440,"internally_reserved":0,"allocated":84410368,"data_stored":82698798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":403099185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003833"},"pg_stats":[{"pgid":"2.1f","version":"29'622","reported_seq":670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.864523+0000","last_change":"2024-01-27T14:59:57.864553+0000","last_active":"2024-01-27T14:59:57.864523+0000","last_peered":"2024-01-27T14:59:57.864523+0000","last_clean":"2024-01-27T14:59:57.864523+0000","last_became_active":"2024-01-27T14:31:50.752048+0000","last_became_peered":"2024-01-27T14:31:50.752048+0000","last_unstale":"2024-01-27T14:59:57.864523+0000","last_undegraded":"2024-01-27T14:59:57.864523+0000","last_fullsized":"2024-01-27T14:59:57.864523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'622","last_scrub_stamp":"2024-01-27T14:59:57.864462+0000","last_deep_scrub":"29'622","last_deep_scrub_stamp":"2024-01-27T14:59:57.864462+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.864462+0000","objects_scrubbed":7,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:05:36.297621+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.952610+0000","last_change":"2024-01-27T15:00:02.952634+0000","last_active":"2024-01-27T15:00:02.952610+0000","last_peered":"2024-01-27T15:00:02.952610+0000","last_clean":"2024-01-27T15:00:02.952610+0000","last_became_active":"2024-01-27T14:31:51.991861+0000","last_became_peered":"2024-01-27T14:31:51.991861+0000","last_unstale":"2024-01-27T15:00:02.952610+0000","last_undegraded":"2024-01-27T15:00:02.952610+0000","last_fullsized":"2024-01-27T15:00:02.952610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-01-27T15:00:02.952543+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-01-27T15:00:02.952543+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.952543+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:25.990345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'167","reported_seq":205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.269818+0000","last_change":"2024-01-27T15:00:05.269843+0000","last_active":"2024-01-27T15:00:05.269818+0000","last_peered":"2024-01-27T15:00:05.269818+0000","last_clean":"2024-01-27T15:00:05.269818+0000","last_became_active":"2024-01-27T14:31:57.750734+0000","last_became_peered":"2024-01-27T14:31:57.750734+0000","last_unstale":"2024-01-27T15:00:05.269818+0000","last_undegraded":"2024-01-27T15:00:05.269818+0000","last_fullsized":"2024-01-27T15:00:05.269818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'167","last_scrub_stamp":"2024-01-27T15:00:05.269733+0000","last_deep_scrub":"29'167","last_deep_scrub_stamp":"2024-01-27T15:00:05.269733+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.269733+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:59.970041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":22350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'729","reported_seq":780,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.899479+0000","last_change":"2024-01-27T15:00:00.899504+0000","last_active":"2024-01-27T15:00:00.899479+0000","last_peered":"2024-01-27T15:00:00.899479+0000","last_clean":"2024-01-27T15:00:00.899479+0000","last_became_active":"2024-01-27T14:31:50.750279+0000","last_became_peered":"2024-01-27T14:31:50.750279+0000","last_unstale":"2024-01-27T15:00:00.899479+0000","last_undegraded":"2024-01-27T15:00:00.899479+0000","last_fullsized":"2024-01-27T15:00:00.899479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'729","last_scrub_stamp":"2024-01-27T15:00:00.899411+0000","last_deep_scrub":"29'729","last_deep_scrub_stamp":"2024-01-27T15:00:00.899411+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.899411+0000","objects_scrubbed":1,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:27.804260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'38","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.921476+0000","last_change":"2024-01-27T14:59:56.921497+0000","last_active":"2024-01-27T14:59:56.921476+0000","last_peered":"2024-01-27T14:59:56.921476+0000","last_clean":"2024-01-27T14:59:56.921476+0000","last_became_active":"2024-01-27T14:31:51.993912+0000","last_became_peered":"2024-01-27T14:31:51.993912+0000","last_unstale":"2024-01-27T14:59:56.921476+0000","last_undegraded":"2024-01-27T14:59:56.921476+0000","last_fullsized":"2024-01-27T14:59:56.921476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:56.921401+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:56.921401+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.921401+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:51:40.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'148","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.761458+0000","last_change":"2024-01-27T15:00:03.761485+0000","last_active":"2024-01-27T15:00:03.761458+0000","last_peered":"2024-01-27T15:00:03.761458+0000","last_clean":"2024-01-27T15:00:03.761458+0000","last_became_active":"2024-01-27T14:31:57.745877+0000","last_became_peered":"2024-01-27T14:31:57.745877+0000","last_unstale":"2024-01-27T15:00:03.761458+0000","last_undegraded":"2024-01-27T15:00:03.761458+0000","last_fullsized":"2024-01-27T15:00:03.761458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2024-01-27T15:00:03.761387+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2024-01-27T15:00:03.761387+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.761387+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:46.373772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":9869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1360","reported_seq":1407,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.458573+0000","last_change":"2024-01-27T14:59:54.458630+0000","last_active":"2024-01-27T14:59:54.458573+0000","last_peered":"2024-01-27T14:59:54.458573+0000","last_clean":"2024-01-27T14:59:54.458573+0000","last_became_active":"2024-01-27T14:31:50.746482+0000","last_became_peered":"2024-01-27T14:31:50.746482+0000","last_unstale":"2024-01-27T14:59:54.458573+0000","last_undegraded":"2024-01-27T14:59:54.458573+0000","last_fullsized":"2024-01-27T14:59:54.458573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1360","last_scrub_stamp":"2024-01-27T14:59:54.458492+0000","last_deep_scrub":"29'1360","last_deep_scrub_stamp":"2024-01-27T14:59:54.458492+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.458492+0000","objects_scrubbed":9,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:41:58.893624+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'33","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.106461+0000","last_change":"2024-01-27T14:59:56.106483+0000","last_active":"2024-01-27T14:59:56.106461+0000","last_peered":"2024-01-27T14:59:56.106461+0000","last_clean":"2024-01-27T14:59:56.106461+0000","last_became_active":"2024-01-27T14:31:52.005342+0000","last_became_peered":"2024-01-27T14:31:52.005342+0000","last_unstale":"2024-01-27T14:59:56.106461+0000","last_undegraded":"2024-01-27T14:59:56.106461+0000","last_fullsized":"2024-01-27T14:59:56.106461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-01-27T14:59:56.106405+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-01-27T14:59:56.106405+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.106405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:57:44.679705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'138","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.783418+0000","last_change":"2024-01-27T15:00:04.783442+0000","last_active":"2024-01-27T15:00:04.783418+0000","last_peered":"2024-01-27T15:00:04.783418+0000","last_clean":"2024-01-27T15:00:04.783418+0000","last_became_active":"2024-01-27T14:31:57.746079+0000","last_became_peered":"2024-01-27T14:31:57.746079+0000","last_unstale":"2024-01-27T15:00:04.783418+0000","last_undegraded":"2024-01-27T15:00:04.783418+0000","last_fullsized":"2024-01-27T15:00:04.783418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'138","last_scrub_stamp":"2024-01-27T15:00:04.783339+0000","last_deep_scrub":"29'138","last_deep_scrub_stamp":"2024-01-27T15:00:04.783339+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.783339+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:31.688188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.514130+0000","last_change":"2024-01-27T14:59:51.514187+0000","last_active":"2024-01-27T14:59:51.514130+0000","last_peered":"2024-01-27T14:59:51.514130+0000","last_clean":"2024-01-27T14:59:51.514130+0000","last_became_active":"2024-01-27T14:31:50.740975+0000","last_became_peered":"2024-01-27T14:31:50.740975+0000","last_unstale":"2024-01-27T14:59:51.514130+0000","last_undegraded":"2024-01-27T14:59:51.514130+0000","last_fullsized":"2024-01-27T14:59:51.514130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-01-27T14:59:51.514059+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.514059+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:51.256705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'47","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:10.957061+0000","last_change":"2024-01-27T15:00:10.957084+0000","last_active":"2024-01-27T15:00:10.957061+0000","last_peered":"2024-01-27T15:00:10.957061+0000","last_clean":"2024-01-27T15:00:10.957061+0000","last_became_active":"2024-01-27T14:31:52.007412+0000","last_became_peered":"2024-01-27T14:31:52.007412+0000","last_unstale":"2024-01-27T15:00:10.957061+0000","last_undegraded":"2024-01-27T15:00:10.957061+0000","last_fullsized":"2024-01-27T15:00:10.957061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-01-27T15:00:10.956990+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-01-27T15:00:10.956990+0000","last_clean_scrub_stamp":"2024-01-27T15:00:10.956990+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:27:02.821309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'132","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.793380+0000","last_change":"2024-01-27T15:00:02.793405+0000","last_active":"2024-01-27T15:00:02.793380+0000","last_peered":"2024-01-27T15:00:02.793380+0000","last_clean":"2024-01-27T15:00:02.793380+0000","last_became_active":"2024-01-27T14:31:57.744528+0000","last_became_peered":"2024-01-27T14:31:57.744528+0000","last_unstale":"2024-01-27T15:00:02.793380+0000","last_undegraded":"2024-01-27T15:00:02.793380+0000","last_fullsized":"2024-01-27T15:00:02.793380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2024-01-27T15:00:02.793303+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2024-01-27T15:00:02.793303+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.793303+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:21:01.752434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":5462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'39","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.104191+0000","last_change":"2024-01-27T14:59:54.104191+0000","last_active":"2024-01-27T14:59:54.104191+0000","last_peered":"2024-01-27T14:59:54.104191+0000","last_clean":"2024-01-27T14:59:54.104191+0000","last_became_active":"2024-01-27T14:31:51.992812+0000","last_became_peered":"2024-01-27T14:31:51.992812+0000","last_unstale":"2024-01-27T14:59:54.104191+0000","last_undegraded":"2024-01-27T14:59:54.104191+0000","last_fullsized":"2024-01-27T14:59:54.104191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-01-27T14:59:54.104043+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.104043+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:24:13.209696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'586","reported_seq":635,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.996589+0000","last_change":"2024-01-27T15:00:01.996624+0000","last_active":"2024-01-27T15:00:01.996589+0000","last_peered":"2024-01-27T15:00:01.996589+0000","last_clean":"2024-01-27T15:00:01.996589+0000","last_became_active":"2024-01-27T14:31:50.749400+0000","last_became_peered":"2024-01-27T14:31:50.749400+0000","last_unstale":"2024-01-27T15:00:01.996589+0000","last_undegraded":"2024-01-27T15:00:01.996589+0000","last_fullsized":"2024-01-27T15:00:01.996589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'586","last_scrub_stamp":"2024-01-27T15:00:01.996513+0000","last_deep_scrub":"29'586","last_deep_scrub_stamp":"2024-01-27T15:00:01.996513+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.996513+0000","objects_scrubbed":3,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:07:35.972358+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'124","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:15.877994+0000","last_change":"2024-01-27T15:00:15.878019+0000","last_active":"2024-01-27T15:00:15.877994+0000","last_peered":"2024-01-27T15:00:15.877994+0000","last_clean":"2024-01-27T15:00:15.877994+0000","last_became_active":"2024-01-27T14:31:57.741400+0000","last_became_peered":"2024-01-27T14:31:57.741400+0000","last_unstale":"2024-01-27T15:00:15.877994+0000","last_undegraded":"2024-01-27T15:00:15.877994+0000","last_fullsized":"2024-01-27T15:00:15.877994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'124","last_scrub_stamp":"2024-01-27T15:00:15.877911+0000","last_deep_scrub":"29'124","last_deep_scrub_stamp":"2024-01-27T15:00:15.877911+0000","last_clean_scrub_stamp":"2024-01-27T15:00:15.877911+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:29:46.697490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'37","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.240823+0000","last_change":"2024-01-27T15:00:00.240861+0000","last_active":"2024-01-27T15:00:00.240823+0000","last_peered":"2024-01-27T15:00:00.240823+0000","last_clean":"2024-01-27T15:00:00.240823+0000","last_became_active":"2024-01-27T14:31:52.008199+0000","last_became_peered":"2024-01-27T14:31:52.008199+0000","last_unstale":"2024-01-27T15:00:00.240823+0000","last_undegraded":"2024-01-27T15:00:00.240823+0000","last_fullsized":"2024-01-27T15:00:00.240823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T15:00:00.240746+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T15:00:00.240746+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.240746+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:28:36.734035+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.234471+0000","last_change":"2024-01-27T14:59:55.234471+0000","last_active":"2024-01-27T14:59:55.234471+0000","last_peered":"2024-01-27T14:59:55.234471+0000","last_clean":"2024-01-27T14:59:55.234471+0000","last_became_active":"2024-01-27T14:31:50.747517+0000","last_became_peered":"2024-01-27T14:31:50.747517+0000","last_unstale":"2024-01-27T14:59:55.234471+0000","last_undegraded":"2024-01-27T14:59:55.234471+0000","last_fullsized":"2024-01-27T14:59:55.234471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-01-27T14:59:55.234378+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-01-27T14:59:55.234378+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.234378+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:04:30.275296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'162","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.429962+0000","last_change":"2024-01-27T15:00:06.429988+0000","last_active":"2024-01-27T15:00:06.429962+0000","last_peered":"2024-01-27T15:00:06.429962+0000","last_clean":"2024-01-27T15:00:06.429962+0000","last_became_active":"2024-01-27T14:31:57.754265+0000","last_became_peered":"2024-01-27T14:31:57.754265+0000","last_unstale":"2024-01-27T15:00:06.429962+0000","last_undegraded":"2024-01-27T15:00:06.429962+0000","last_fullsized":"2024-01-27T15:00:06.429962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'162","last_scrub_stamp":"2024-01-27T15:00:06.429886+0000","last_deep_scrub":"29'162","last_deep_scrub_stamp":"2024-01-27T15:00:06.429886+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.429886+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:51:20.969650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.890644+0000","last_change":"2024-01-27T14:59:52.890644+0000","last_active":"2024-01-27T14:59:52.890644+0000","last_peered":"2024-01-27T14:59:52.890644+0000","last_clean":"2024-01-27T14:59:52.890644+0000","last_became_active":"2024-01-27T14:31:52.006550+0000","last_became_peered":"2024-01-27T14:31:52.006550+0000","last_unstale":"2024-01-27T14:59:52.890644+0000","last_undegraded":"2024-01-27T14:59:52.890644+0000","last_fullsized":"2024-01-27T14:59:52.890644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:52.890548+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.890548+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:40:48.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.934725+0000","last_change":"2024-01-27T14:59:53.934725+0000","last_active":"2024-01-27T14:59:53.934725+0000","last_peered":"2024-01-27T14:59:53.934725+0000","last_clean":"2024-01-27T14:59:53.934725+0000","last_became_active":"2024-01-27T14:31:50.742265+0000","last_became_peered":"2024-01-27T14:31:50.742265+0000","last_unstale":"2024-01-27T14:59:53.934725+0000","last_undegraded":"2024-01-27T14:59:53.934725+0000","last_fullsized":"2024-01-27T14:59:53.934725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-01-27T14:59:53.934640+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-01-27T14:59:53.934640+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.934640+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:17:08.484277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'133","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.265363+0000","last_change":"2024-01-27T15:00:02.265389+0000","last_active":"2024-01-27T15:00:02.265363+0000","last_peered":"2024-01-27T15:00:02.265363+0000","last_clean":"2024-01-27T15:00:02.265363+0000","last_became_active":"2024-01-27T14:31:57.737875+0000","last_became_peered":"2024-01-27T14:31:57.737875+0000","last_unstale":"2024-01-27T15:00:02.265363+0000","last_undegraded":"2024-01-27T15:00:02.265363+0000","last_fullsized":"2024-01-27T15:00:02.265363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'133","last_scrub_stamp":"2024-01-27T15:00:02.265286+0000","last_deep_scrub":"29'133","last_deep_scrub_stamp":"2024-01-27T15:00:02.265286+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.265286+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:37.738203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":11618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.026301+0000","last_change":"2024-01-27T15:00:00.026301+0000","last_active":"2024-01-27T15:00:00.026301+0000","last_peered":"2024-01-27T15:00:00.026301+0000","last_clean":"2024-01-27T15:00:00.026301+0000","last_became_active":"2024-01-27T14:31:51.999870+0000","last_became_peered":"2024-01-27T14:31:51.999870+0000","last_unstale":"2024-01-27T15:00:00.026301+0000","last_undegraded":"2024-01-27T15:00:00.026301+0000","last_fullsized":"2024-01-27T15:00:00.026301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:00.026204+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:00.026204+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.026204+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:10:48.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'7","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.519205+0000","last_change":"2024-01-27T14:59:52.519205+0000","last_active":"2024-01-27T14:59:52.519205+0000","last_peered":"2024-01-27T14:59:52.519205+0000","last_clean":"2024-01-27T14:59:52.519205+0000","last_became_active":"2024-01-27T14:31:50.740934+0000","last_became_peered":"2024-01-27T14:31:50.740934+0000","last_unstale":"2024-01-27T14:59:52.519205+0000","last_undegraded":"2024-01-27T14:59:52.519205+0000","last_fullsized":"2024-01-27T14:59:52.519205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-01-27T14:59:52.519116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.519116+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:32:55.885458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'115","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.858961+0000","last_change":"2024-01-27T14:59:59.858989+0000","last_active":"2024-01-27T14:59:59.858961+0000","last_peered":"2024-01-27T14:59:59.858961+0000","last_clean":"2024-01-27T14:59:59.858961+0000","last_became_active":"2024-01-27T14:31:57.744086+0000","last_became_peered":"2024-01-27T14:31:57.744086+0000","last_unstale":"2024-01-27T14:59:59.858961+0000","last_undegraded":"2024-01-27T14:59:59.858961+0000","last_fullsized":"2024-01-27T14:59:59.858961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'115","last_scrub_stamp":"2024-01-27T14:59:59.858877+0000","last_deep_scrub":"29'115","last_deep_scrub_stamp":"2024-01-27T14:59:59.858877+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.858877+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:51:30.642384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":6907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'39","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.812041+0000","last_change":"2024-01-27T15:00:02.812041+0000","last_active":"2024-01-27T15:00:02.812041+0000","last_peered":"2024-01-27T15:00:02.812041+0000","last_clean":"2024-01-27T15:00:02.812041+0000","last_became_active":"2024-01-27T14:31:52.007443+0000","last_became_peered":"2024-01-27T14:31:52.007443+0000","last_unstale":"2024-01-27T15:00:02.812041+0000","last_undegraded":"2024-01-27T15:00:02.812041+0000","last_fullsized":"2024-01-27T15:00:02.812041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-01-27T15:00:02.811957+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-01-27T15:00:02.811957+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.811957+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:41:33.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'18","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.036805+0000","last_change":"2024-01-27T15:00:01.036805+0000","last_active":"2024-01-27T15:00:01.036805+0000","last_peered":"2024-01-27T15:00:01.036805+0000","last_clean":"2024-01-27T15:00:01.036805+0000","last_became_active":"2024-01-27T14:31:50.753926+0000","last_became_peered":"2024-01-27T14:31:50.753926+0000","last_unstale":"2024-01-27T15:00:01.036805+0000","last_undegraded":"2024-01-27T15:00:01.036805+0000","last_fullsized":"2024-01-27T15:00:01.036805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-01-27T15:00:01.036662+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-01-27T15:00:01.036662+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.036662+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:54:35.448159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'154","reported_seq":194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.777394+0000","last_change":"2024-01-27T15:00:05.777420+0000","last_active":"2024-01-27T15:00:05.777394+0000","last_peered":"2024-01-27T15:00:05.777394+0000","last_clean":"2024-01-27T15:00:05.777394+0000","last_became_active":"2024-01-27T14:31:57.747404+0000","last_became_peered":"2024-01-27T14:31:57.747404+0000","last_unstale":"2024-01-27T15:00:05.777394+0000","last_undegraded":"2024-01-27T15:00:05.777394+0000","last_fullsized":"2024-01-27T15:00:05.777394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'154","last_scrub_stamp":"2024-01-27T15:00:05.777327+0000","last_deep_scrub":"29'154","last_deep_scrub_stamp":"2024-01-27T15:00:05.777327+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.777327+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:31.595434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.839004+0000","last_change":"2024-01-27T15:00:01.839004+0000","last_active":"2024-01-27T15:00:01.839004+0000","last_peered":"2024-01-27T15:00:01.839004+0000","last_clean":"2024-01-27T15:00:01.839004+0000","last_became_active":"2024-01-27T14:31:52.006523+0000","last_became_peered":"2024-01-27T14:31:52.006523+0000","last_unstale":"2024-01-27T15:00:01.839004+0000","last_undegraded":"2024-01-27T15:00:01.839004+0000","last_fullsized":"2024-01-27T15:00:01.839004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:01.838919+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:01.838919+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.838919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:56.795815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'319","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.921420+0000","last_change":"2024-01-27T14:59:54.921420+0000","last_active":"2024-01-27T14:59:54.921420+0000","last_peered":"2024-01-27T14:59:54.921420+0000","last_clean":"2024-01-27T14:59:54.921420+0000","last_became_active":"2024-01-27T14:31:50.742869+0000","last_became_peered":"2024-01-27T14:31:50.742869+0000","last_unstale":"2024-01-27T14:59:54.921420+0000","last_undegraded":"2024-01-27T14:59:54.921420+0000","last_fullsized":"2024-01-27T14:59:54.921420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'319","last_scrub_stamp":"2024-01-27T14:59:54.921271+0000","last_deep_scrub":"29'319","last_deep_scrub_stamp":"2024-01-27T14:59:54.921271+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.921271+0000","objects_scrubbed":4,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:01:25.624484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'136","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.775159+0000","last_change":"2024-01-27T15:00:05.775180+0000","last_active":"2024-01-27T15:00:05.775159+0000","last_peered":"2024-01-27T15:00:05.775159+0000","last_clean":"2024-01-27T15:00:05.775159+0000","last_became_active":"2024-01-27T14:31:57.746807+0000","last_became_peered":"2024-01-27T14:31:57.746807+0000","last_unstale":"2024-01-27T15:00:05.775159+0000","last_undegraded":"2024-01-27T15:00:05.775159+0000","last_fullsized":"2024-01-27T15:00:05.775159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2024-01-27T15:00:05.775092+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2024-01-27T15:00:05.775092+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.775092+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:09:10.343605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":8365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.200619+0000","last_change":"2024-01-27T15:00:02.200644+0000","last_active":"2024-01-27T15:00:02.200619+0000","last_peered":"2024-01-27T15:00:02.200619+0000","last_clean":"2024-01-27T15:00:02.200619+0000","last_became_active":"2024-01-27T14:31:52.007326+0000","last_became_peered":"2024-01-27T14:31:52.007326+0000","last_unstale":"2024-01-27T15:00:02.200619+0000","last_undegraded":"2024-01-27T15:00:02.200619+0000","last_fullsized":"2024-01-27T15:00:02.200619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:02.200539+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:02.200539+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.200539+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:03:08.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'11","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.968360+0000","last_change":"2024-01-27T15:00:05.968385+0000","last_active":"2024-01-27T15:00:05.968360+0000","last_peered":"2024-01-27T15:00:05.968360+0000","last_clean":"2024-01-27T15:00:05.968360+0000","last_became_active":"2024-01-27T14:31:50.752261+0000","last_became_peered":"2024-01-27T14:31:50.752261+0000","last_unstale":"2024-01-27T15:00:05.968360+0000","last_undegraded":"2024-01-27T15:00:05.968360+0000","last_fullsized":"2024-01-27T15:00:05.968360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-01-27T15:00:05.968299+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-01-27T15:00:05.968299+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.968299+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:38:48.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'120","reported_seq":160,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.104875+0000","last_change":"2024-01-27T15:00:08.104915+0000","last_active":"2024-01-27T15:00:08.104875+0000","last_peered":"2024-01-27T15:00:08.104875+0000","last_clean":"2024-01-27T15:00:08.104875+0000","last_became_active":"2024-01-27T14:31:57.753902+0000","last_became_peered":"2024-01-27T14:31:57.753902+0000","last_unstale":"2024-01-27T15:00:08.104875+0000","last_undegraded":"2024-01-27T15:00:08.104875+0000","last_fullsized":"2024-01-27T15:00:08.104875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'120","last_scrub_stamp":"2024-01-27T15:00:08.104787+0000","last_deep_scrub":"29'120","last_deep_scrub_stamp":"2024-01-27T15:00:08.104787+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.104787+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:04:33.523806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.764160+0000","last_change":"2024-01-27T14:59:56.764183+0000","last_active":"2024-01-27T14:59:56.764160+0000","last_peered":"2024-01-27T14:59:56.764160+0000","last_clean":"2024-01-27T14:59:56.764160+0000","last_became_active":"2024-01-27T14:31:52.009649+0000","last_became_peered":"2024-01-27T14:31:52.009649+0000","last_unstale":"2024-01-27T14:59:56.764160+0000","last_undegraded":"2024-01-27T14:59:56.764160+0000","last_fullsized":"2024-01-27T14:59:56.764160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:56.764086+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:56.764086+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.764086+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:33:00.130428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.926032+0000","last_change":"2024-01-27T14:59:57.926055+0000","last_active":"2024-01-27T14:59:57.926032+0000","last_peered":"2024-01-27T14:59:57.926032+0000","last_clean":"2024-01-27T14:59:57.926032+0000","last_became_active":"2024-01-27T14:31:50.745835+0000","last_became_peered":"2024-01-27T14:31:50.745835+0000","last_unstale":"2024-01-27T14:59:57.926032+0000","last_undegraded":"2024-01-27T14:59:57.926032+0000","last_fullsized":"2024-01-27T14:59:57.926032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-27T14:59:57.925963+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-27T14:59:57.925963+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.925963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:23:43.628346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'197","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.138569+0000","last_change":"2024-01-27T15:00:05.138593+0000","last_active":"2024-01-27T15:00:05.138569+0000","last_peered":"2024-01-27T15:00:05.138569+0000","last_clean":"2024-01-27T15:00:05.138569+0000","last_became_active":"2024-01-27T14:31:57.748478+0000","last_became_peered":"2024-01-27T14:31:57.748478+0000","last_unstale":"2024-01-27T15:00:05.138569+0000","last_undegraded":"2024-01-27T15:00:05.138569+0000","last_fullsized":"2024-01-27T15:00:05.138569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'197","last_scrub_stamp":"2024-01-27T15:00:05.138497+0000","last_deep_scrub":"29'197","last_deep_scrub_stamp":"2024-01-27T15:00:05.138497+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.138497+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:19:41.247455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":12865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'31","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.424296+0000","last_change":"2024-01-27T15:00:00.424342+0000","last_active":"2024-01-27T15:00:00.424296+0000","last_peered":"2024-01-27T15:00:00.424296+0000","last_clean":"2024-01-27T15:00:00.424296+0000","last_became_active":"2024-01-27T14:31:52.008028+0000","last_became_peered":"2024-01-27T14:31:52.008028+0000","last_unstale":"2024-01-27T15:00:00.424296+0000","last_undegraded":"2024-01-27T15:00:00.424296+0000","last_fullsized":"2024-01-27T15:00:00.424296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T15:00:00.424209+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T15:00:00.424209+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.424209+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:43.036593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.963017+0000","last_change":"2024-01-27T15:00:07.963042+0000","last_active":"2024-01-27T15:00:07.963017+0000","last_peered":"2024-01-27T15:00:07.963017+0000","last_clean":"2024-01-27T15:00:07.963017+0000","last_became_active":"2024-01-27T14:31:50.752912+0000","last_became_peered":"2024-01-27T14:31:50.752912+0000","last_unstale":"2024-01-27T15:00:07.963017+0000","last_undegraded":"2024-01-27T15:00:07.963017+0000","last_fullsized":"2024-01-27T15:00:07.963017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-01-27T15:00:07.962954+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-01-27T15:00:07.962954+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.962954+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:03:37.223074+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'123","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.144900+0000","last_change":"2024-01-27T15:00:09.144924+0000","last_active":"2024-01-27T15:00:09.144900+0000","last_peered":"2024-01-27T15:00:09.144900+0000","last_clean":"2024-01-27T15:00:09.144900+0000","last_became_active":"2024-01-27T14:32:21.653792+0000","last_became_peered":"2024-01-27T14:32:21.653792+0000","last_unstale":"2024-01-27T15:00:09.144900+0000","last_undegraded":"2024-01-27T15:00:09.144900+0000","last_fullsized":"2024-01-27T15:00:09.144900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'123","last_scrub_stamp":"2024-01-27T15:00:09.144832+0000","last_deep_scrub":"29'123","last_deep_scrub_stamp":"2024-01-27T15:00:09.144832+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.144832+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:24:42.178813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,3],"acting":[6,4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'33","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.938257+0000","last_change":"2024-01-27T15:00:07.938281+0000","last_active":"2024-01-27T15:00:07.938257+0000","last_peered":"2024-01-27T15:00:07.938257+0000","last_clean":"2024-01-27T15:00:07.938257+0000","last_became_active":"2024-01-27T14:31:52.008528+0000","last_became_peered":"2024-01-27T14:31:52.008528+0000","last_unstale":"2024-01-27T15:00:07.938257+0000","last_undegraded":"2024-01-27T15:00:07.938257+0000","last_fullsized":"2024-01-27T15:00:07.938257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-01-27T15:00:07.938192+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-01-27T15:00:07.938192+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.938192+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:02:27.495513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'936","reported_seq":1909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.295938+0000","last_change":"2024-01-27T14:59:56.295979+0000","last_active":"2024-01-27T14:59:56.295938+0000","last_peered":"2024-01-27T14:59:56.295938+0000","last_clean":"2024-01-27T14:59:56.295938+0000","last_became_active":"2024-01-27T14:31:50.747257+0000","last_became_peered":"2024-01-27T14:31:50.747257+0000","last_unstale":"2024-01-27T14:59:56.295938+0000","last_undegraded":"2024-01-27T14:59:56.295938+0000","last_fullsized":"2024-01-27T14:59:56.295938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'936","last_scrub_stamp":"2024-01-27T14:59:56.295875+0000","last_deep_scrub":"29'936","last_deep_scrub_stamp":"2024-01-27T14:59:56.295875+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.295875+0000","objects_scrubbed":4,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:53:50.675856+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":932,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'157","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.129925+0000","last_change":"2024-01-27T15:00:07.129925+0000","last_active":"2024-01-27T15:00:07.129925+0000","last_peered":"2024-01-27T15:00:07.129925+0000","last_clean":"2024-01-27T15:00:07.129925+0000","last_became_active":"2024-01-27T14:31:57.753146+0000","last_became_peered":"2024-01-27T14:31:57.753146+0000","last_unstale":"2024-01-27T15:00:07.129925+0000","last_undegraded":"2024-01-27T15:00:07.129925+0000","last_fullsized":"2024-01-27T15:00:07.129925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'157","last_scrub_stamp":"2024-01-27T15:00:07.129834+0000","last_deep_scrub":"29'157","last_deep_scrub_stamp":"2024-01-27T15:00:07.129834+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.129834+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:05:37.883092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'29","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.168569+0000","last_change":"2024-01-27T14:59:58.168600+0000","last_active":"2024-01-27T14:59:58.168569+0000","last_peered":"2024-01-27T14:59:58.168569+0000","last_clean":"2024-01-27T14:59:58.168569+0000","last_became_active":"2024-01-27T14:31:52.004924+0000","last_became_peered":"2024-01-27T14:31:52.004924+0000","last_unstale":"2024-01-27T14:59:58.168569+0000","last_undegraded":"2024-01-27T14:59:58.168569+0000","last_fullsized":"2024-01-27T14:59:58.168569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T14:59:58.168477+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T14:59:58.168477+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.168477+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:49.579594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'480","reported_seq":531,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.010895+0000","last_change":"2024-01-27T15:00:07.010943+0000","last_active":"2024-01-27T15:00:07.010895+0000","last_peered":"2024-01-27T15:00:07.010895+0000","last_clean":"2024-01-27T15:00:07.010895+0000","last_became_active":"2024-01-27T14:31:50.752861+0000","last_became_peered":"2024-01-27T14:31:50.752861+0000","last_unstale":"2024-01-27T15:00:07.010895+0000","last_undegraded":"2024-01-27T15:00:07.010895+0000","last_fullsized":"2024-01-27T15:00:07.010895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'480","last_scrub_stamp":"2024-01-27T15:00:07.010804+0000","last_deep_scrub":"29'480","last_deep_scrub_stamp":"2024-01-27T15:00:07.010804+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.010804+0000","objects_scrubbed":2,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:09.366096+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'136","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:11.862379+0000","last_change":"2024-01-27T15:00:11.862406+0000","last_active":"2024-01-27T15:00:11.862379+0000","last_peered":"2024-01-27T15:00:11.862379+0000","last_clean":"2024-01-27T15:00:11.862379+0000","last_became_active":"2024-01-27T14:31:57.745726+0000","last_became_peered":"2024-01-27T14:31:57.745726+0000","last_unstale":"2024-01-27T15:00:11.862379+0000","last_undegraded":"2024-01-27T15:00:11.862379+0000","last_fullsized":"2024-01-27T15:00:11.862379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2024-01-27T15:00:11.862306+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2024-01-27T15:00:11.862306+0000","last_clean_scrub_stamp":"2024-01-27T15:00:11.862306+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:57:16.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.887487+0000","last_change":"2024-01-27T15:00:00.887530+0000","last_active":"2024-01-27T15:00:00.887487+0000","last_peered":"2024-01-27T15:00:00.887487+0000","last_clean":"2024-01-27T15:00:00.887487+0000","last_became_active":"2024-01-27T14:31:52.002821+0000","last_became_peered":"2024-01-27T14:31:52.002821+0000","last_unstale":"2024-01-27T15:00:00.887487+0000","last_undegraded":"2024-01-27T15:00:00.887487+0000","last_fullsized":"2024-01-27T15:00:00.887487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:00.887360+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:00.887360+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.887360+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:16:31.648233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'17","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.951893+0000","last_change":"2024-01-27T15:00:02.951925+0000","last_active":"2024-01-27T15:00:02.951893+0000","last_peered":"2024-01-27T15:00:02.951893+0000","last_clean":"2024-01-27T15:00:02.951893+0000","last_became_active":"2024-01-27T14:31:50.749942+0000","last_became_peered":"2024-01-27T14:31:50.749942+0000","last_unstale":"2024-01-27T15:00:02.951893+0000","last_undegraded":"2024-01-27T15:00:02.951893+0000","last_fullsized":"2024-01-27T15:00:02.951893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-01-27T15:00:02.951813+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-01-27T15:00:02.951813+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.951813+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:54:06.153021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.074075+0000","last_change":"2024-01-27T14:59:51.074105+0000","last_active":"2024-01-27T14:59:51.074075+0000","last_peered":"2024-01-27T14:59:51.074075+0000","last_clean":"2024-01-27T14:59:51.074075+0000","last_became_active":"2024-01-27T14:31:31.262365+0000","last_became_peered":"2024-01-27T14:31:31.262365+0000","last_unstale":"2024-01-27T14:59:51.074075+0000","last_undegraded":"2024-01-27T14:59:51.074075+0000","last_fullsized":"2024-01-27T14:59:51.074075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-01-27T14:59:51.074018+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.074018+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:28:32.754624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'162","reported_seq":202,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:16.871015+0000","last_change":"2024-01-27T15:00:16.871039+0000","last_active":"2024-01-27T15:00:16.871015+0000","last_peered":"2024-01-27T15:00:16.871015+0000","last_clean":"2024-01-27T15:00:16.871015+0000","last_became_active":"2024-01-27T14:31:57.750907+0000","last_became_peered":"2024-01-27T14:31:57.750907+0000","last_unstale":"2024-01-27T15:00:16.871015+0000","last_undegraded":"2024-01-27T15:00:16.871015+0000","last_fullsized":"2024-01-27T15:00:16.871015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'162","last_scrub_stamp":"2024-01-27T15:00:16.870948+0000","last_deep_scrub":"29'162","last_deep_scrub_stamp":"2024-01-27T15:00:16.870948+0000","last_clean_scrub_stamp":"2024-01-27T15:00:16.870948+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:16:48.493745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.090252+0000","last_change":"2024-01-27T14:59:53.090272+0000","last_active":"2024-01-27T14:59:53.090252+0000","last_peered":"2024-01-27T14:59:53.090252+0000","last_clean":"2024-01-27T14:59:53.090252+0000","last_became_active":"2024-01-27T14:31:51.992769+0000","last_became_peered":"2024-01-27T14:31:51.992769+0000","last_unstale":"2024-01-27T14:59:53.090252+0000","last_undegraded":"2024-01-27T14:59:53.090252+0000","last_fullsized":"2024-01-27T14:59:53.090252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:53.090187+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.090187+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:08:50.389343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'13","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.242232+0000","last_change":"2024-01-27T14:59:56.242273+0000","last_active":"2024-01-27T14:59:56.242232+0000","last_peered":"2024-01-27T14:59:56.242232+0000","last_clean":"2024-01-27T14:59:56.242232+0000","last_became_active":"2024-01-27T14:31:50.748457+0000","last_became_peered":"2024-01-27T14:31:50.748457+0000","last_unstale":"2024-01-27T14:59:56.242232+0000","last_undegraded":"2024-01-27T14:59:56.242232+0000","last_fullsized":"2024-01-27T14:59:56.242232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-01-27T14:59:56.242158+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-01-27T14:59:56.242158+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.242158+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:58:50.907940+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'145","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.887151+0000","last_change":"2024-01-27T15:00:00.887151+0000","last_active":"2024-01-27T15:00:00.887151+0000","last_peered":"2024-01-27T15:00:00.887151+0000","last_clean":"2024-01-27T15:00:00.887151+0000","last_became_active":"2024-01-27T14:31:57.744296+0000","last_became_peered":"2024-01-27T14:31:57.744296+0000","last_unstale":"2024-01-27T15:00:00.887151+0000","last_undegraded":"2024-01-27T15:00:00.887151+0000","last_fullsized":"2024-01-27T15:00:00.887151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'145","last_scrub_stamp":"2024-01-27T15:00:00.887064+0000","last_deep_scrub":"29'145","last_deep_scrub_stamp":"2024-01-27T15:00:00.887064+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.887064+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:16.892935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":5006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.497345+0000","last_change":"2024-01-27T15:00:03.497366+0000","last_active":"2024-01-27T15:00:03.497345+0000","last_peered":"2024-01-27T15:00:03.497345+0000","last_clean":"2024-01-27T15:00:03.497345+0000","last_became_active":"2024-01-27T14:31:52.008832+0000","last_became_peered":"2024-01-27T14:31:52.008832+0000","last_unstale":"2024-01-27T15:00:03.497345+0000","last_undegraded":"2024-01-27T15:00:03.497345+0000","last_fullsized":"2024-01-27T15:00:03.497345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:03.497277+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:03.497277+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.497277+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:29.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.938085+0000","last_change":"2024-01-27T14:59:59.938111+0000","last_active":"2024-01-27T14:59:59.938085+0000","last_peered":"2024-01-27T14:59:59.938085+0000","last_clean":"2024-01-27T14:59:59.938085+0000","last_became_active":"2024-01-27T14:31:50.749189+0000","last_became_peered":"2024-01-27T14:31:50.749189+0000","last_unstale":"2024-01-27T14:59:59.938085+0000","last_undegraded":"2024-01-27T14:59:59.938085+0000","last_fullsized":"2024-01-27T14:59:59.938085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T14:59:59.938023+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T14:59:59.938023+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.938023+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:55:42.550408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'183","reported_seq":222,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.895420+0000","last_change":"2024-01-27T15:00:09.895449+0000","last_active":"2024-01-27T15:00:09.895420+0000","last_peered":"2024-01-27T15:00:09.895420+0000","last_clean":"2024-01-27T15:00:09.895420+0000","last_became_active":"2024-01-27T14:31:57.735799+0000","last_became_peered":"2024-01-27T14:31:57.735799+0000","last_unstale":"2024-01-27T15:00:09.895420+0000","last_undegraded":"2024-01-27T15:00:09.895420+0000","last_fullsized":"2024-01-27T15:00:09.895420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'183","last_scrub_stamp":"2024-01-27T15:00:09.895348+0000","last_deep_scrub":"29'183","last_deep_scrub_stamp":"2024-01-27T15:00:09.895348+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.895348+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:47:10.698566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.440228+0000","last_change":"2024-01-27T15:00:01.440250+0000","last_active":"2024-01-27T15:00:01.440228+0000","last_peered":"2024-01-27T15:00:01.440228+0000","last_clean":"2024-01-27T15:00:01.440228+0000","last_became_active":"2024-01-27T14:31:52.008149+0000","last_became_peered":"2024-01-27T14:31:52.008149+0000","last_unstale":"2024-01-27T15:00:01.440228+0000","last_undegraded":"2024-01-27T15:00:01.440228+0000","last_fullsized":"2024-01-27T15:00:01.440228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T15:00:01.440158+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T15:00:01.440158+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.440158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:45:51.230781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.903470+0000","last_change":"2024-01-27T14:59:55.903514+0000","last_active":"2024-01-27T14:59:55.903470+0000","last_peered":"2024-01-27T14:59:55.903470+0000","last_clean":"2024-01-27T14:59:55.903470+0000","last_became_active":"2024-01-27T14:31:50.746978+0000","last_became_peered":"2024-01-27T14:31:50.746978+0000","last_unstale":"2024-01-27T14:59:55.903470+0000","last_undegraded":"2024-01-27T14:59:55.903470+0000","last_fullsized":"2024-01-27T14:59:55.903470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-01-27T14:59:55.903368+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-01-27T14:59:55.903368+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.903368+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:18:18.467083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:13.883460+0000","last_change":"2024-01-27T15:00:13.883508+0000","last_active":"2024-01-27T15:00:13.883460+0000","last_peered":"2024-01-27T15:00:13.883460+0000","last_clean":"2024-01-27T15:00:13.883460+0000","last_became_active":"2024-01-27T14:31:57.735352+0000","last_became_peered":"2024-01-27T14:31:57.735352+0000","last_unstale":"2024-01-27T15:00:13.883460+0000","last_undegraded":"2024-01-27T15:00:13.883460+0000","last_fullsized":"2024-01-27T15:00:13.883460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2024-01-27T15:00:13.883344+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2024-01-27T15:00:13.883344+0000","last_clean_scrub_stamp":"2024-01-27T15:00:13.883344+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:30:59.096087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":6428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'22","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.835476+0000","last_change":"2024-01-27T14:59:58.835499+0000","last_active":"2024-01-27T14:59:58.835476+0000","last_peered":"2024-01-27T14:59:58.835476+0000","last_clean":"2024-01-27T14:59:58.835476+0000","last_became_active":"2024-01-27T14:31:52.010387+0000","last_became_peered":"2024-01-27T14:31:52.010387+0000","last_unstale":"2024-01-27T14:59:58.835476+0000","last_undegraded":"2024-01-27T14:59:58.835476+0000","last_fullsized":"2024-01-27T14:59:58.835476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-01-27T14:59:58.835403+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-01-27T14:59:58.835403+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.835403+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:42:03.270535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.482452+0000","last_change":"2024-01-27T14:59:53.482502+0000","last_active":"2024-01-27T14:59:53.482452+0000","last_peered":"2024-01-27T14:59:53.482452+0000","last_clean":"2024-01-27T14:59:53.482452+0000","last_became_active":"2024-01-27T14:31:50.746134+0000","last_became_peered":"2024-01-27T14:31:50.746134+0000","last_unstale":"2024-01-27T14:59:53.482452+0000","last_undegraded":"2024-01-27T14:59:53.482452+0000","last_fullsized":"2024-01-27T14:59:53.482452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-01-27T14:59:53.482327+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.482327+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:48.182635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'164","reported_seq":204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.087921+0000","last_change":"2024-01-27T14:59:58.087921+0000","last_active":"2024-01-27T14:59:58.087921+0000","last_peered":"2024-01-27T14:59:58.087921+0000","last_clean":"2024-01-27T14:59:58.087921+0000","last_became_active":"2024-01-27T14:31:57.735342+0000","last_became_peered":"2024-01-27T14:31:57.735342+0000","last_unstale":"2024-01-27T14:59:58.087921+0000","last_undegraded":"2024-01-27T14:59:58.087921+0000","last_fullsized":"2024-01-27T14:59:58.087921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'164","last_scrub_stamp":"2024-01-27T14:59:58.087843+0000","last_deep_scrub":"29'164","last_deep_scrub_stamp":"2024-01-27T14:59:58.087843+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.087843+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:39.234454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":10977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.085858+0000","last_change":"2024-01-27T14:59:56.085901+0000","last_active":"2024-01-27T14:59:56.085858+0000","last_peered":"2024-01-27T14:59:56.085858+0000","last_clean":"2024-01-27T14:59:56.085858+0000","last_became_active":"2024-01-27T14:31:51.993612+0000","last_became_peered":"2024-01-27T14:31:51.993612+0000","last_unstale":"2024-01-27T14:59:56.085858+0000","last_undegraded":"2024-01-27T14:59:56.085858+0000","last_fullsized":"2024-01-27T14:59:56.085858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T14:59:56.085771+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T14:59:56.085771+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.085771+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:19.123573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'29","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.859688+0000","last_change":"2024-01-27T14:59:56.859736+0000","last_active":"2024-01-27T14:59:56.859688+0000","last_peered":"2024-01-27T14:59:56.859688+0000","last_clean":"2024-01-27T14:59:56.859688+0000","last_became_active":"2024-01-27T14:31:50.747419+0000","last_became_peered":"2024-01-27T14:31:50.747419+0000","last_unstale":"2024-01-27T14:59:56.859688+0000","last_undegraded":"2024-01-27T14:59:56.859688+0000","last_fullsized":"2024-01-27T14:59:56.859688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T14:59:56.859615+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T14:59:56.859615+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.859615+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:06:09.514907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'143","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:10.883059+0000","last_change":"2024-01-27T15:00:10.883102+0000","last_active":"2024-01-27T15:00:10.883059+0000","last_peered":"2024-01-27T15:00:10.883059+0000","last_clean":"2024-01-27T15:00:10.883059+0000","last_became_active":"2024-01-27T14:31:57.744224+0000","last_became_peered":"2024-01-27T14:31:57.744224+0000","last_unstale":"2024-01-27T15:00:10.883059+0000","last_undegraded":"2024-01-27T15:00:10.883059+0000","last_fullsized":"2024-01-27T15:00:10.883059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2024-01-27T15:00:10.882939+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2024-01-27T15:00:10.882939+0000","last_clean_scrub_stamp":"2024-01-27T15:00:10.882939+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:22:40.860403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'31","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.075077+0000","last_change":"2024-01-27T14:59:53.075077+0000","last_active":"2024-01-27T14:59:53.075077+0000","last_peered":"2024-01-27T14:59:53.075077+0000","last_clean":"2024-01-27T14:59:53.075077+0000","last_became_active":"2024-01-27T14:31:51.992539+0000","last_became_peered":"2024-01-27T14:31:51.992539+0000","last_unstale":"2024-01-27T14:59:53.075077+0000","last_undegraded":"2024-01-27T14:59:53.075077+0000","last_fullsized":"2024-01-27T14:59:53.075077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T14:59:53.074985+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.074985+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:38:41.272079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:56.428768+0000","last_change":"2024-01-27T14:59:56.428803+0000","last_active":"2024-01-27T14:59:56.428768+0000","last_peered":"2024-01-27T14:59:56.428768+0000","last_clean":"2024-01-27T14:59:56.428768+0000","last_became_active":"2024-01-27T14:31:50.752002+0000","last_became_peered":"2024-01-27T14:31:50.752002+0000","last_unstale":"2024-01-27T14:59:56.428768+0000","last_undegraded":"2024-01-27T14:59:56.428768+0000","last_fullsized":"2024-01-27T14:59:56.428768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-01-27T14:59:56.428693+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-01-27T14:59:56.428693+0000","last_clean_scrub_stamp":"2024-01-27T14:59:56.428693+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:12.434563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'119","reported_seq":157,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:12.911258+0000","last_change":"2024-01-27T15:00:12.911281+0000","last_active":"2024-01-27T15:00:12.911258+0000","last_peered":"2024-01-27T15:00:12.911258+0000","last_clean":"2024-01-27T15:00:12.911258+0000","last_became_active":"2024-01-27T14:31:57.745789+0000","last_became_peered":"2024-01-27T14:31:57.745789+0000","last_unstale":"2024-01-27T15:00:12.911258+0000","last_undegraded":"2024-01-27T15:00:12.911258+0000","last_fullsized":"2024-01-27T15:00:12.911258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-01-27T15:00:12.911176+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-01-27T15:00:12.911176+0000","last_clean_scrub_stamp":"2024-01-27T15:00:12.911176+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:03:55.285890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:12.925777+0000","last_change":"2024-01-27T15:00:12.925816+0000","last_active":"2024-01-27T15:00:12.925777+0000","last_peered":"2024-01-27T15:00:12.925777+0000","last_clean":"2024-01-27T15:00:12.925777+0000","last_became_active":"2024-01-27T14:31:52.011257+0000","last_became_peered":"2024-01-27T14:31:52.011257+0000","last_unstale":"2024-01-27T15:00:12.925777+0000","last_undegraded":"2024-01-27T15:00:12.925777+0000","last_fullsized":"2024-01-27T15:00:12.925777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T15:00:12.925687+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T15:00:12.925687+0000","last_clean_scrub_stamp":"2024-01-27T15:00:12.925687+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:09.364615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.976645+0000","last_change":"2024-01-27T15:00:04.976672+0000","last_active":"2024-01-27T15:00:04.976645+0000","last_peered":"2024-01-27T15:00:04.976645+0000","last_clean":"2024-01-27T15:00:04.976645+0000","last_became_active":"2024-01-27T14:31:50.751990+0000","last_became_peered":"2024-01-27T14:31:50.751990+0000","last_unstale":"2024-01-27T15:00:04.976645+0000","last_undegraded":"2024-01-27T15:00:04.976645+0000","last_fullsized":"2024-01-27T15:00:04.976645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-01-27T15:00:04.976585+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-01-27T15:00:04.976585+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.976585+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:08:04.738934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'108","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.114571+0000","last_change":"2024-01-27T15:00:06.114594+0000","last_active":"2024-01-27T15:00:06.114571+0000","last_peered":"2024-01-27T15:00:06.114571+0000","last_clean":"2024-01-27T15:00:06.114571+0000","last_became_active":"2024-01-27T14:31:57.751774+0000","last_became_peered":"2024-01-27T14:31:57.751774+0000","last_unstale":"2024-01-27T15:00:06.114571+0000","last_undegraded":"2024-01-27T15:00:06.114571+0000","last_fullsized":"2024-01-27T15:00:06.114571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'108","last_scrub_stamp":"2024-01-27T15:00:06.114507+0000","last_deep_scrub":"29'108","last_deep_scrub_stamp":"2024-01-27T15:00:06.114507+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.114507+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:04:35.642102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:00.133029+0000","last_change":"2024-01-27T15:00:00.133051+0000","last_active":"2024-01-27T15:00:00.133029+0000","last_peered":"2024-01-27T15:00:00.133029+0000","last_clean":"2024-01-27T15:00:00.133029+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T15:00:00.133029+0000","last_undegraded":"2024-01-27T15:00:00.133029+0000","last_fullsized":"2024-01-27T15:00:00.133029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-01-27T15:00:00.132961+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-01-27T15:00:00.132961+0000","last_clean_scrub_stamp":"2024-01-27T15:00:00.132961+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:36:10.877935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'266","reported_seq":314,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.252051+0000","last_change":"2024-01-27T14:59:57.252079+0000","last_active":"2024-01-27T14:59:57.252051+0000","last_peered":"2024-01-27T14:59:57.252051+0000","last_clean":"2024-01-27T14:59:57.252051+0000","last_became_active":"2024-01-27T14:31:50.750903+0000","last_became_peered":"2024-01-27T14:31:50.750903+0000","last_unstale":"2024-01-27T14:59:57.252051+0000","last_undegraded":"2024-01-27T14:59:57.252051+0000","last_fullsized":"2024-01-27T14:59:57.252051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'266","last_scrub_stamp":"2024-01-27T14:59:57.251999+0000","last_deep_scrub":"29'266","last_deep_scrub_stamp":"2024-01-27T14:59:57.251999+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.251999+0000","objects_scrubbed":7,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:10:03.041865+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2282702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'132","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.788182+0000","last_change":"2024-01-27T15:00:06.788206+0000","last_active":"2024-01-27T15:00:06.788182+0000","last_peered":"2024-01-27T15:00:06.788182+0000","last_clean":"2024-01-27T15:00:06.788182+0000","last_became_active":"2024-01-27T14:32:21.653739+0000","last_became_peered":"2024-01-27T14:32:21.653739+0000","last_unstale":"2024-01-27T15:00:06.788182+0000","last_undegraded":"2024-01-27T15:00:06.788182+0000","last_fullsized":"2024-01-27T15:00:06.788182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2024-01-27T15:00:06.788113+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2024-01-27T15:00:06.788113+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.788113+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:29.825915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.454017+0000","last_change":"2024-01-27T15:00:04.454040+0000","last_active":"2024-01-27T15:00:04.454017+0000","last_peered":"2024-01-27T15:00:04.454017+0000","last_clean":"2024-01-27T15:00:04.454017+0000","last_became_active":"2024-01-27T14:31:52.009501+0000","last_became_peered":"2024-01-27T14:31:52.009501+0000","last_unstale":"2024-01-27T15:00:04.454017+0000","last_undegraded":"2024-01-27T15:00:04.454017+0000","last_fullsized":"2024-01-27T15:00:04.454017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:04.453937+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:04.453937+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.453937+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:40:21.637483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":882,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:51.841211+0000","last_change":"2024-01-27T14:59:51.841211+0000","last_active":"2024-01-27T14:59:51.841211+0000","last_peered":"2024-01-27T14:59:51.841211+0000","last_clean":"2024-01-27T14:59:51.841211+0000","last_became_active":"2024-01-27T14:31:50.744064+0000","last_became_peered":"2024-01-27T14:31:50.744064+0000","last_unstale":"2024-01-27T14:59:51.841211+0000","last_undegraded":"2024-01-27T14:59:51.841211+0000","last_fullsized":"2024-01-27T14:59:51.841211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'834","last_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_deep_scrub":"29'834","last_deep_scrub_stamp":"2024-01-27T14:59:51.841116+0000","last_clean_scrub_stamp":"2024-01-27T14:59:51.841116+0000","objects_scrubbed":6,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:29:32.987727+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":4543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'138","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:07.769421+0000","last_change":"2024-01-27T15:00:07.769445+0000","last_active":"2024-01-27T15:00:07.769421+0000","last_peered":"2024-01-27T15:00:07.769421+0000","last_clean":"2024-01-27T15:00:07.769421+0000","last_became_active":"2024-01-27T14:31:57.750008+0000","last_became_peered":"2024-01-27T14:31:57.750008+0000","last_unstale":"2024-01-27T15:00:07.769421+0000","last_undegraded":"2024-01-27T15:00:07.769421+0000","last_fullsized":"2024-01-27T15:00:07.769421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'138","last_scrub_stamp":"2024-01-27T15:00:07.769342+0000","last_deep_scrub":"29'138","last_deep_scrub_stamp":"2024-01-27T15:00:07.769342+0000","last_clean_scrub_stamp":"2024-01-27T15:00:07.769342+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:24:40.803323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":9013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.135414+0000","last_change":"2024-01-27T14:59:55.135414+0000","last_active":"2024-01-27T14:59:55.135414+0000","last_peered":"2024-01-27T14:59:55.135414+0000","last_clean":"2024-01-27T14:59:55.135414+0000","last_became_active":"2024-01-27T14:31:51.992327+0000","last_became_peered":"2024-01-27T14:31:51.992327+0000","last_unstale":"2024-01-27T14:59:55.135414+0000","last_undegraded":"2024-01-27T14:59:55.135414+0000","last_fullsized":"2024-01-27T14:59:55.135414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:55.135333+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:55.135333+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.135333+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:16:42.700238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'632","reported_seq":679,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.250111+0000","last_change":"2024-01-27T14:59:58.250138+0000","last_active":"2024-01-27T14:59:58.250111+0000","last_peered":"2024-01-27T14:59:58.250111+0000","last_clean":"2024-01-27T14:59:58.250111+0000","last_became_active":"2024-01-27T14:31:50.751938+0000","last_became_peered":"2024-01-27T14:31:50.751938+0000","last_unstale":"2024-01-27T14:59:58.250111+0000","last_undegraded":"2024-01-27T14:59:58.250111+0000","last_fullsized":"2024-01-27T14:59:58.250111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'632","last_scrub_stamp":"2024-01-27T14:59:58.250050+0000","last_deep_scrub":"29'632","last_deep_scrub_stamp":"2024-01-27T14:59:58.250050+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.250050+0000","objects_scrubbed":4,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:15:28.700192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'166","reported_seq":205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.837966+0000","last_change":"2024-01-27T15:00:01.837989+0000","last_active":"2024-01-27T15:00:01.837966+0000","last_peered":"2024-01-27T15:00:01.837966+0000","last_clean":"2024-01-27T15:00:01.837966+0000","last_became_active":"2024-01-27T14:31:57.744017+0000","last_became_peered":"2024-01-27T14:31:57.744017+0000","last_unstale":"2024-01-27T15:00:01.837966+0000","last_undegraded":"2024-01-27T15:00:01.837966+0000","last_fullsized":"2024-01-27T15:00:01.837966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'166","last_scrub_stamp":"2024-01-27T15:00:01.837888+0000","last_deep_scrub":"29'166","last_deep_scrub_stamp":"2024-01-27T15:00:01.837888+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.837888+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:23:47.540270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":23904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.938263+0000","last_change":"2024-01-27T15:00:01.938285+0000","last_active":"2024-01-27T15:00:01.938263+0000","last_peered":"2024-01-27T15:00:01.938263+0000","last_clean":"2024-01-27T15:00:01.938263+0000","last_became_active":"2024-01-27T14:31:51.917019+0000","last_became_peered":"2024-01-27T14:31:51.917019+0000","last_unstale":"2024-01-27T15:00:01.938263+0000","last_undegraded":"2024-01-27T15:00:01.938263+0000","last_fullsized":"2024-01-27T15:00:01.938263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T15:00:01.938193+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T15:00:01.938193+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.938193+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:56:27.756300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.476249+0000","last_change":"2024-01-27T14:59:55.476278+0000","last_active":"2024-01-27T14:59:55.476249+0000","last_peered":"2024-01-27T14:59:55.476249+0000","last_clean":"2024-01-27T14:59:55.476249+0000","last_became_active":"2024-01-27T14:31:50.746918+0000","last_became_peered":"2024-01-27T14:31:50.746918+0000","last_unstale":"2024-01-27T14:59:55.476249+0000","last_undegraded":"2024-01-27T14:59:55.476249+0000","last_fullsized":"2024-01-27T14:59:55.476249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-01-27T14:59:55.476186+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-01-27T14:59:55.476186+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.476186+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:01:30.301012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'126","reported_seq":165,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.278233+0000","last_change":"2024-01-27T15:00:03.278272+0000","last_active":"2024-01-27T15:00:03.278233+0000","last_peered":"2024-01-27T15:00:03.278233+0000","last_clean":"2024-01-27T15:00:03.278233+0000","last_became_active":"2024-01-27T14:31:57.739431+0000","last_became_peered":"2024-01-27T14:31:57.739431+0000","last_unstale":"2024-01-27T15:00:03.278233+0000","last_undegraded":"2024-01-27T15:00:03.278233+0000","last_fullsized":"2024-01-27T15:00:03.278233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'126","last_scrub_stamp":"2024-01-27T15:00:03.278140+0000","last_deep_scrub":"29'126","last_deep_scrub_stamp":"2024-01-27T15:00:03.278140+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.278140+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:51:09.051410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":10446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'40","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.817209+0000","last_change":"2024-01-27T14:59:52.817230+0000","last_active":"2024-01-27T14:59:52.817209+0000","last_peered":"2024-01-27T14:59:52.817209+0000","last_clean":"2024-01-27T14:59:52.817209+0000","last_became_active":"2024-01-27T14:31:51.995189+0000","last_became_peered":"2024-01-27T14:31:51.995189+0000","last_unstale":"2024-01-27T14:59:52.817209+0000","last_undegraded":"2024-01-27T14:59:52.817209+0000","last_fullsized":"2024-01-27T14:59:52.817209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-01-27T14:59:52.817143+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.817143+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:28:29.310432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:52.031357+0000","last_change":"2024-01-27T14:59:52.031381+0000","last_active":"2024-01-27T14:59:52.031357+0000","last_peered":"2024-01-27T14:59:52.031357+0000","last_clean":"2024-01-27T14:59:52.031357+0000","last_became_active":"2024-01-27T14:31:50.730788+0000","last_became_peered":"2024-01-27T14:31:50.730788+0000","last_unstale":"2024-01-27T14:59:52.031357+0000","last_undegraded":"2024-01-27T14:59:52.031357+0000","last_fullsized":"2024-01-27T14:59:52.031357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-01-27T14:59:52.031300+0000","last_clean_scrub_stamp":"2024-01-27T14:59:52.031300+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:12.849424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'149","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.776675+0000","last_change":"2024-01-27T15:00:06.776714+0000","last_active":"2024-01-27T15:00:06.776675+0000","last_peered":"2024-01-27T15:00:06.776675+0000","last_clean":"2024-01-27T15:00:06.776675+0000","last_became_active":"2024-01-27T14:31:57.748999+0000","last_became_peered":"2024-01-27T14:31:57.748999+0000","last_unstale":"2024-01-27T15:00:06.776675+0000","last_undegraded":"2024-01-27T15:00:06.776675+0000","last_fullsized":"2024-01-27T15:00:06.776675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'149","last_scrub_stamp":"2024-01-27T15:00:06.776575+0000","last_deep_scrub":"29'149","last_deep_scrub_stamp":"2024-01-27T15:00:06.776575+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.776575+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:04:32.195594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":10684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'137","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.765112+0000","last_change":"2024-01-27T15:00:08.765155+0000","last_active":"2024-01-27T15:00:08.765112+0000","last_peered":"2024-01-27T15:00:08.765112+0000","last_clean":"2024-01-27T15:00:08.765112+0000","last_became_active":"2024-01-27T14:32:21.653800+0000","last_became_peered":"2024-01-27T14:32:21.653800+0000","last_unstale":"2024-01-27T15:00:08.765112+0000","last_undegraded":"2024-01-27T15:00:08.765112+0000","last_fullsized":"2024-01-27T15:00:08.765112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'137","last_scrub_stamp":"2024-01-27T15:00:08.765030+0000","last_deep_scrub":"29'137","last_deep_scrub_stamp":"2024-01-27T15:00:08.765030+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.765030+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:27:58.586393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'41","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.884730+0000","last_change":"2024-01-27T14:59:58.884751+0000","last_active":"2024-01-27T14:59:58.884730+0000","last_peered":"2024-01-27T14:59:58.884730+0000","last_clean":"2024-01-27T14:59:58.884730+0000","last_became_active":"2024-01-27T14:31:51.999665+0000","last_became_peered":"2024-01-27T14:31:51.999665+0000","last_unstale":"2024-01-27T14:59:58.884730+0000","last_undegraded":"2024-01-27T14:59:58.884730+0000","last_fullsized":"2024-01-27T14:59:58.884730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T14:59:58.884663+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T14:59:58.884663+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.884663+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:34:56.905840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.979956+0000","last_change":"2024-01-27T15:00:03.979983+0000","last_active":"2024-01-27T15:00:03.979956+0000","last_peered":"2024-01-27T15:00:03.979956+0000","last_clean":"2024-01-27T15:00:03.979956+0000","last_became_active":"2024-01-27T14:31:50.751488+0000","last_became_peered":"2024-01-27T14:31:50.751488+0000","last_unstale":"2024-01-27T15:00:03.979956+0000","last_undegraded":"2024-01-27T15:00:03.979956+0000","last_fullsized":"2024-01-27T15:00:03.979956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T15:00:03.979881+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T15:00:03.979881+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.979881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:52.883472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'155","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:14.889308+0000","last_change":"2024-01-27T15:00:14.889338+0000","last_active":"2024-01-27T15:00:14.889308+0000","last_peered":"2024-01-27T15:00:14.889308+0000","last_clean":"2024-01-27T15:00:14.889308+0000","last_became_active":"2024-01-27T14:31:57.735789+0000","last_became_peered":"2024-01-27T14:31:57.735789+0000","last_unstale":"2024-01-27T15:00:14.889308+0000","last_undegraded":"2024-01-27T15:00:14.889308+0000","last_fullsized":"2024-01-27T15:00:14.889308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'155","last_scrub_stamp":"2024-01-27T15:00:14.889201+0000","last_deep_scrub":"29'155","last_deep_scrub_stamp":"2024-01-27T15:00:14.889201+0000","last_clean_scrub_stamp":"2024-01-27T15:00:14.889201+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:33:19.659245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":16458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'41","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.910486+0000","last_change":"2024-01-27T15:00:05.910506+0000","last_active":"2024-01-27T15:00:05.910486+0000","last_peered":"2024-01-27T15:00:05.910486+0000","last_clean":"2024-01-27T15:00:05.910486+0000","last_became_active":"2024-01-27T14:31:52.006377+0000","last_became_peered":"2024-01-27T14:31:52.006377+0000","last_unstale":"2024-01-27T15:00:05.910486+0000","last_undegraded":"2024-01-27T15:00:05.910486+0000","last_fullsized":"2024-01-27T15:00:05.910486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-01-27T15:00:05.910420+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-01-27T15:00:05.910420+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.910420+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:02:20.652286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.194043+0000","last_change":"2024-01-27T14:59:57.194068+0000","last_active":"2024-01-27T14:59:57.194043+0000","last_peered":"2024-01-27T14:59:57.194043+0000","last_clean":"2024-01-27T14:59:57.194043+0000","last_became_active":"2024-01-27T14:31:50.748442+0000","last_became_peered":"2024-01-27T14:31:50.748442+0000","last_unstale":"2024-01-27T14:59:57.194043+0000","last_undegraded":"2024-01-27T14:59:57.194043+0000","last_fullsized":"2024-01-27T14:59:57.194043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-27T14:59:57.193984+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-27T14:59:57.193984+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.193984+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:08:01.550419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'664","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.012278+0000","last_change":"2024-01-27T15:00:09.012314+0000","last_active":"2024-01-27T15:00:09.012278+0000","last_peered":"2024-01-27T15:00:09.012278+0000","last_clean":"2024-01-27T15:00:09.012278+0000","last_became_active":"2024-01-27T14:31:50.753853+0000","last_became_peered":"2024-01-27T14:31:50.753853+0000","last_unstale":"2024-01-27T15:00:09.012278+0000","last_undegraded":"2024-01-27T15:00:09.012278+0000","last_fullsized":"2024-01-27T15:00:09.012278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'664","last_scrub_stamp":"2024-01-27T15:00:09.012205+0000","last_deep_scrub":"29'664","last_deep_scrub_stamp":"2024-01-27T15:00:09.012205+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.012205+0000","objects_scrubbed":4,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:36.310699+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'38","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.765670+0000","last_change":"2024-01-27T15:00:03.765691+0000","last_active":"2024-01-27T15:00:03.765670+0000","last_peered":"2024-01-27T15:00:03.765670+0000","last_clean":"2024-01-27T15:00:03.765670+0000","last_became_active":"2024-01-27T14:31:52.009708+0000","last_became_peered":"2024-01-27T14:31:52.009708+0000","last_unstale":"2024-01-27T15:00:03.765670+0000","last_undegraded":"2024-01-27T15:00:03.765670+0000","last_fullsized":"2024-01-27T15:00:03.765670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:03.765611+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:03.765611+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.765611+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:52.673313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'95","reported_seq":133,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.725241+0000","last_change":"2024-01-27T15:00:04.725266+0000","last_active":"2024-01-27T15:00:04.725241+0000","last_peered":"2024-01-27T15:00:04.725241+0000","last_clean":"2024-01-27T15:00:04.725241+0000","last_became_active":"2024-01-27T14:31:57.746779+0000","last_became_peered":"2024-01-27T14:31:57.746779+0000","last_unstale":"2024-01-27T15:00:04.725241+0000","last_undegraded":"2024-01-27T15:00:04.725241+0000","last_fullsized":"2024-01-27T15:00:04.725241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'95","last_scrub_stamp":"2024-01-27T15:00:04.725161+0000","last_deep_scrub":"29'95","last_deep_scrub_stamp":"2024-01-27T15:00:04.725161+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.725161+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:04:34.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":7934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'690","reported_seq":738,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.914432+0000","last_change":"2024-01-27T14:59:58.914460+0000","last_active":"2024-01-27T14:59:58.914432+0000","last_peered":"2024-01-27T14:59:58.914432+0000","last_clean":"2024-01-27T14:59:58.914432+0000","last_became_active":"2024-01-27T14:31:50.746368+0000","last_became_peered":"2024-01-27T14:31:50.746368+0000","last_unstale":"2024-01-27T14:59:58.914432+0000","last_undegraded":"2024-01-27T14:59:58.914432+0000","last_fullsized":"2024-01-27T14:59:58.914432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'690","last_scrub_stamp":"2024-01-27T14:59:58.914363+0000","last_deep_scrub":"29'690","last_deep_scrub_stamp":"2024-01-27T14:59:58.914363+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.914363+0000","objects_scrubbed":3,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:20:57.873494+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.098443+0000","last_change":"2024-01-27T14:59:54.098480+0000","last_active":"2024-01-27T14:59:54.098443+0000","last_peered":"2024-01-27T14:59:54.098443+0000","last_clean":"2024-01-27T14:59:54.098443+0000","last_became_active":"2024-01-27T14:31:51.993979+0000","last_became_peered":"2024-01-27T14:31:51.993979+0000","last_unstale":"2024-01-27T14:59:54.098443+0000","last_undegraded":"2024-01-27T14:59:54.098443+0000","last_fullsized":"2024-01-27T14:59:54.098443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2024-01-27T14:59:54.098350+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.098350+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:00:06.958729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'152","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.318645+0000","last_change":"2024-01-27T15:00:04.318670+0000","last_active":"2024-01-27T15:00:04.318645+0000","last_peered":"2024-01-27T15:00:04.318645+0000","last_clean":"2024-01-27T15:00:04.318645+0000","last_became_active":"2024-01-27T14:31:57.750946+0000","last_became_peered":"2024-01-27T14:31:57.750946+0000","last_unstale":"2024-01-27T15:00:04.318645+0000","last_undegraded":"2024-01-27T15:00:04.318645+0000","last_fullsized":"2024-01-27T15:00:04.318645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'152","last_scrub_stamp":"2024-01-27T15:00:04.318565+0000","last_deep_scrub":"29'152","last_deep_scrub_stamp":"2024-01-27T15:00:04.318565+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.318565+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:33:07.684907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":11967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'51","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.799851+0000","last_change":"2024-01-27T14:59:57.799874+0000","last_active":"2024-01-27T14:59:57.799851+0000","last_peered":"2024-01-27T14:59:57.799851+0000","last_clean":"2024-01-27T14:59:57.799851+0000","last_became_active":"2024-01-27T14:31:52.010304+0000","last_became_peered":"2024-01-27T14:31:52.010304+0000","last_unstale":"2024-01-27T14:59:57.799851+0000","last_undegraded":"2024-01-27T14:59:57.799851+0000","last_fullsized":"2024-01-27T14:59:57.799851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-01-27T14:59:57.799762+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-01-27T14:59:57.799762+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.799762+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:52.500070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'50","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.269889+0000","last_change":"2024-01-27T14:59:59.269931+0000","last_active":"2024-01-27T14:59:59.269889+0000","last_peered":"2024-01-27T14:59:59.269889+0000","last_clean":"2024-01-27T14:59:59.269889+0000","last_became_active":"2024-01-27T14:31:52.008037+0000","last_became_peered":"2024-01-27T14:31:52.008037+0000","last_unstale":"2024-01-27T14:59:59.269889+0000","last_undegraded":"2024-01-27T14:59:59.269889+0000","last_fullsized":"2024-01-27T14:59:59.269889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-01-27T14:59:59.269814+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-01-27T14:59:59.269814+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.269814+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:34:42.923047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'47","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.059176+0000","last_change":"2024-01-27T14:59:59.059200+0000","last_active":"2024-01-27T14:59:59.059176+0000","last_peered":"2024-01-27T14:59:59.059176+0000","last_clean":"2024-01-27T14:59:59.059176+0000","last_became_active":"2024-01-27T14:31:51.915663+0000","last_became_peered":"2024-01-27T14:31:51.915663+0000","last_unstale":"2024-01-27T14:59:59.059176+0000","last_undegraded":"2024-01-27T14:59:59.059176+0000","last_fullsized":"2024-01-27T14:59:59.059176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-01-27T14:59:59.059097+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-01-27T14:59:59.059097+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.059097+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:02:13.800964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.821428+0000","last_change":"2024-01-27T14:59:53.821466+0000","last_active":"2024-01-27T14:59:53.821428+0000","last_peered":"2024-01-27T14:59:53.821428+0000","last_clean":"2024-01-27T14:59:53.821428+0000","last_became_active":"2024-01-27T14:31:52.004580+0000","last_became_peered":"2024-01-27T14:31:52.004580+0000","last_unstale":"2024-01-27T14:59:53.821428+0000","last_undegraded":"2024-01-27T14:59:53.821428+0000","last_fullsized":"2024-01-27T14:59:53.821428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T14:59:53.821328+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.821328+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:58:09.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'29","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.178937+0000","last_change":"2024-01-27T15:00:04.178959+0000","last_active":"2024-01-27T15:00:04.178937+0000","last_peered":"2024-01-27T15:00:04.178937+0000","last_clean":"2024-01-27T15:00:04.178937+0000","last_became_active":"2024-01-27T14:31:52.011025+0000","last_became_peered":"2024-01-27T14:31:52.011025+0000","last_unstale":"2024-01-27T15:00:04.178937+0000","last_undegraded":"2024-01-27T15:00:04.178937+0000","last_fullsized":"2024-01-27T15:00:04.178937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-01-27T15:00:04.178830+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-01-27T15:00:04.178830+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.178830+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:59.135726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.175439+0000","last_change":"2024-01-27T15:00:01.175439+0000","last_active":"2024-01-27T15:00:01.175439+0000","last_peered":"2024-01-27T15:00:01.175439+0000","last_clean":"2024-01-27T15:00:01.175439+0000","last_became_active":"2024-01-27T14:31:52.006577+0000","last_became_peered":"2024-01-27T14:31:52.006577+0000","last_unstale":"2024-01-27T15:00:01.175439+0000","last_undegraded":"2024-01-27T15:00:01.175439+0000","last_fullsized":"2024-01-27T15:00:01.175439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:01.175324+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:01.175324+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.175324+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:19:46.737006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'45","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:53.806394+0000","last_change":"2024-01-27T14:59:53.806394+0000","last_active":"2024-01-27T14:59:53.806394+0000","last_peered":"2024-01-27T14:59:53.806394+0000","last_clean":"2024-01-27T14:59:53.806394+0000","last_became_active":"2024-01-27T14:31:51.995167+0000","last_became_peered":"2024-01-27T14:31:51.995167+0000","last_unstale":"2024-01-27T14:59:53.806394+0000","last_undegraded":"2024-01-27T14:59:53.806394+0000","last_fullsized":"2024-01-27T14:59:53.806394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-01-27T14:59:53.806267+0000","last_clean_scrub_stamp":"2024-01-27T14:59:53.806267+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:51.580529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:04.922845+0000","last_change":"2024-01-27T15:00:04.922883+0000","last_active":"2024-01-27T15:00:04.922845+0000","last_peered":"2024-01-27T15:00:04.922845+0000","last_clean":"2024-01-27T15:00:04.922845+0000","last_became_active":"2024-01-27T14:31:51.993792+0000","last_became_peered":"2024-01-27T14:31:51.993792+0000","last_unstale":"2024-01-27T15:00:04.922845+0000","last_undegraded":"2024-01-27T15:00:04.922845+0000","last_fullsized":"2024-01-27T15:00:04.922845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:04.922717+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:04.922717+0000","last_clean_scrub_stamp":"2024-01-27T15:00:04.922717+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T02:51:19.462480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'34","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.038151+0000","last_change":"2024-01-27T14:59:57.038151+0000","last_active":"2024-01-27T14:59:57.038151+0000","last_peered":"2024-01-27T14:59:57.038151+0000","last_clean":"2024-01-27T14:59:57.038151+0000","last_became_active":"2024-01-27T14:31:51.915717+0000","last_became_peered":"2024-01-27T14:31:51.915717+0000","last_unstale":"2024-01-27T14:59:57.038151+0000","last_undegraded":"2024-01-27T14:59:57.038151+0000","last_fullsized":"2024-01-27T14:59:57.038151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:57.038064+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:57.038064+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.038064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:18:08.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'44","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.953847+0000","last_change":"2024-01-27T15:00:03.953869+0000","last_active":"2024-01-27T15:00:03.953847+0000","last_peered":"2024-01-27T15:00:03.953847+0000","last_clean":"2024-01-27T15:00:03.953847+0000","last_became_active":"2024-01-27T14:31:51.993551+0000","last_became_peered":"2024-01-27T14:31:51.993551+0000","last_unstale":"2024-01-27T15:00:03.953847+0000","last_undegraded":"2024-01-27T15:00:03.953847+0000","last_fullsized":"2024-01-27T15:00:03.953847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-01-27T15:00:03.953766+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-01-27T15:00:03.953766+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.953766+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:18:15.127188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'38","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.062856+0000","last_change":"2024-01-27T14:59:57.062881+0000","last_active":"2024-01-27T14:59:57.062856+0000","last_peered":"2024-01-27T14:59:57.062856+0000","last_clean":"2024-01-27T14:59:57.062856+0000","last_became_active":"2024-01-27T14:31:52.005892+0000","last_became_peered":"2024-01-27T14:31:52.005892+0000","last_unstale":"2024-01-27T14:59:57.062856+0000","last_undegraded":"2024-01-27T14:59:57.062856+0000","last_fullsized":"2024-01-27T14:59:57.062856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T14:59:57.062797+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T14:59:57.062797+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.062797+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:33:39.085492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'49","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.866610+0000","last_change":"2024-01-27T14:59:59.866630+0000","last_active":"2024-01-27T14:59:59.866610+0000","last_peered":"2024-01-27T14:59:59.866610+0000","last_clean":"2024-01-27T14:59:59.866610+0000","last_became_active":"2024-01-27T14:31:52.002103+0000","last_became_peered":"2024-01-27T14:31:52.002103+0000","last_unstale":"2024-01-27T14:59:59.866610+0000","last_undegraded":"2024-01-27T14:59:59.866610+0000","last_fullsized":"2024-01-27T14:59:59.866610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T14:59:59.866553+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T14:59:59.866553+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.866553+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:42.619239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'42","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:02.468290+0000","last_change":"2024-01-27T15:00:02.468311+0000","last_active":"2024-01-27T15:00:02.468290+0000","last_peered":"2024-01-27T15:00:02.468290+0000","last_clean":"2024-01-27T15:00:02.468290+0000","last_became_active":"2024-01-27T14:31:52.008482+0000","last_became_peered":"2024-01-27T14:31:52.008482+0000","last_unstale":"2024-01-27T15:00:02.468290+0000","last_undegraded":"2024-01-27T15:00:02.468290+0000","last_fullsized":"2024-01-27T15:00:02.468290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-01-27T15:00:02.468220+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-01-27T15:00:02.468220+0000","last_clean_scrub_stamp":"2024-01-27T15:00:02.468220+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:57:29.373068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:09.995199+0000","last_change":"2024-01-27T15:00:09.995240+0000","last_active":"2024-01-27T15:00:09.995199+0000","last_peered":"2024-01-27T15:00:09.995199+0000","last_clean":"2024-01-27T15:00:09.995199+0000","last_became_active":"2024-01-27T14:31:52.000530+0000","last_became_peered":"2024-01-27T14:31:52.000530+0000","last_unstale":"2024-01-27T15:00:09.995199+0000","last_undegraded":"2024-01-27T15:00:09.995199+0000","last_fullsized":"2024-01-27T15:00:09.995199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:09.995122+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:09.995122+0000","last_clean_scrub_stamp":"2024-01-27T15:00:09.995122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:20:53.284314+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'49","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:01.237155+0000","last_change":"2024-01-27T15:00:01.237177+0000","last_active":"2024-01-27T15:00:01.237155+0000","last_peered":"2024-01-27T15:00:01.237155+0000","last_clean":"2024-01-27T15:00:01.237155+0000","last_became_active":"2024-01-27T14:31:52.008527+0000","last_became_peered":"2024-01-27T14:31:52.008527+0000","last_unstale":"2024-01-27T15:00:01.237155+0000","last_undegraded":"2024-01-27T15:00:01.237155+0000","last_fullsized":"2024-01-27T15:00:01.237155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-01-27T15:00:01.237076+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-01-27T15:00:01.237076+0000","last_clean_scrub_stamp":"2024-01-27T15:00:01.237076+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:32:07.949509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:11.917211+0000","last_change":"2024-01-27T15:00:11.917240+0000","last_active":"2024-01-27T15:00:11.917211+0000","last_peered":"2024-01-27T15:00:11.917211+0000","last_clean":"2024-01-27T15:00:11.917211+0000","last_became_active":"2024-01-27T14:31:52.008760+0000","last_became_peered":"2024-01-27T14:31:52.008760+0000","last_unstale":"2024-01-27T15:00:11.917211+0000","last_undegraded":"2024-01-27T15:00:11.917211+0000","last_fullsized":"2024-01-27T15:00:11.917211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-01-27T15:00:11.917122+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-01-27T15:00:11.917122+0000","last_clean_scrub_stamp":"2024-01-27T15:00:11.917122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:16.440681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'43","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.086820+0000","last_change":"2024-01-27T14:59:58.086859+0000","last_active":"2024-01-27T14:59:58.086820+0000","last_peered":"2024-01-27T14:59:58.086820+0000","last_clean":"2024-01-27T14:59:58.086820+0000","last_became_active":"2024-01-27T14:31:51.993576+0000","last_became_peered":"2024-01-27T14:31:51.993576+0000","last_unstale":"2024-01-27T14:59:58.086820+0000","last_undegraded":"2024-01-27T14:59:58.086820+0000","last_fullsized":"2024-01-27T14:59:58.086820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-01-27T14:59:58.086712+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-01-27T14:59:58.086712+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.086712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:33:18.128270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'42","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.874907+0000","last_change":"2024-01-27T14:59:55.874930+0000","last_active":"2024-01-27T14:59:55.874907+0000","last_peered":"2024-01-27T14:59:55.874907+0000","last_clean":"2024-01-27T14:59:55.874907+0000","last_became_active":"2024-01-27T14:31:52.005730+0000","last_became_peered":"2024-01-27T14:31:52.005730+0000","last_unstale":"2024-01-27T14:59:55.874907+0000","last_undegraded":"2024-01-27T14:59:55.874907+0000","last_fullsized":"2024-01-27T14:59:55.874907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-01-27T14:59:55.874845+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-01-27T14:59:55.874845+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.874845+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:51:26.658352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:03.185919+0000","last_change":"2024-01-27T15:00:03.185957+0000","last_active":"2024-01-27T15:00:03.185919+0000","last_peered":"2024-01-27T15:00:03.185919+0000","last_clean":"2024-01-27T15:00:03.185919+0000","last_became_active":"2024-01-27T14:31:52.007311+0000","last_became_peered":"2024-01-27T14:31:52.007311+0000","last_unstale":"2024-01-27T15:00:03.185919+0000","last_undegraded":"2024-01-27T15:00:03.185919+0000","last_fullsized":"2024-01-27T15:00:03.185919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T15:00:03.185824+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T15:00:03.185824+0000","last_clean_scrub_stamp":"2024-01-27T15:00:03.185824+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:17:07.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'37","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.148824+0000","last_change":"2024-01-27T14:59:59.148863+0000","last_active":"2024-01-27T14:59:59.148824+0000","last_peered":"2024-01-27T14:59:59.148824+0000","last_clean":"2024-01-27T14:59:59.148824+0000","last_became_active":"2024-01-27T14:31:52.005377+0000","last_became_peered":"2024-01-27T14:31:52.005377+0000","last_unstale":"2024-01-27T14:59:59.148824+0000","last_undegraded":"2024-01-27T14:59:59.148824+0000","last_fullsized":"2024-01-27T14:59:59.148824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-01-27T14:59:59.148733+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-01-27T14:59:59.148733+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.148733+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:31:04.323273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'28","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:59.415134+0000","last_change":"2024-01-27T14:59:59.415156+0000","last_active":"2024-01-27T14:59:59.415134+0000","last_peered":"2024-01-27T14:59:59.415134+0000","last_clean":"2024-01-27T14:59:59.415134+0000","last_became_active":"2024-01-27T14:31:52.006957+0000","last_became_peered":"2024-01-27T14:31:52.006957+0000","last_unstale":"2024-01-27T14:59:59.415134+0000","last_undegraded":"2024-01-27T14:59:59.415134+0000","last_fullsized":"2024-01-27T14:59:59.415134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-01-27T14:59:59.415062+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-01-27T14:59:59.415062+0000","last_clean_scrub_stamp":"2024-01-27T14:59:59.415062+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:39:15.567607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:50.525972+0000","last_change":"2024-01-27T14:59:50.526009+0000","last_active":"2024-01-27T14:59:50.525972+0000","last_peered":"2024-01-27T14:59:50.525972+0000","last_clean":"2024-01-27T14:59:50.525972+0000","last_became_active":"2024-01-27T14:31:52.005436+0000","last_became_peered":"2024-01-27T14:31:52.005436+0000","last_unstale":"2024-01-27T14:59:50.525972+0000","last_undegraded":"2024-01-27T14:59:50.525972+0000","last_fullsized":"2024-01-27T14:59:50.525972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T14:59:50.525903+0000","last_clean_scrub_stamp":"2024-01-27T14:59:50.525903+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:25.998821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:57.447013+0000","last_change":"2024-01-27T14:59:57.447041+0000","last_active":"2024-01-27T14:59:57.447013+0000","last_peered":"2024-01-27T14:59:57.447013+0000","last_clean":"2024-01-27T14:59:57.447013+0000","last_became_active":"2024-01-27T14:31:52.004848+0000","last_became_peered":"2024-01-27T14:31:52.004848+0000","last_unstale":"2024-01-27T14:59:57.447013+0000","last_undegraded":"2024-01-27T14:59:57.447013+0000","last_fullsized":"2024-01-27T14:59:57.447013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-01-27T14:59:57.446941+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-01-27T14:59:57.446941+0000","last_clean_scrub_stamp":"2024-01-27T14:59:57.446941+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:32:22.552837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'36","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.104686+0000","last_change":"2024-01-27T14:59:55.104708+0000","last_active":"2024-01-27T14:59:55.104686+0000","last_peered":"2024-01-27T14:59:55.104686+0000","last_clean":"2024-01-27T14:59:55.104686+0000","last_became_active":"2024-01-27T14:31:51.995293+0000","last_became_peered":"2024-01-27T14:31:51.995293+0000","last_unstale":"2024-01-27T14:59:55.104686+0000","last_undegraded":"2024-01-27T14:59:55.104686+0000","last_fullsized":"2024-01-27T14:59:55.104686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T14:59:55.104623+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T14:59:55.104623+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.104623+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:53:49.484603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'31","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.925932+0000","last_change":"2024-01-27T15:00:06.925953+0000","last_active":"2024-01-27T15:00:06.925932+0000","last_peered":"2024-01-27T15:00:06.925932+0000","last_clean":"2024-01-27T15:00:06.925932+0000","last_became_active":"2024-01-27T14:31:52.008191+0000","last_became_peered":"2024-01-27T14:31:52.008191+0000","last_unstale":"2024-01-27T15:00:06.925932+0000","last_undegraded":"2024-01-27T15:00:06.925932+0000","last_fullsized":"2024-01-27T15:00:06.925932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-01-27T15:00:06.925870+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-01-27T15:00:06.925870+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.925870+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:10:55.699665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:05.430001+0000","last_change":"2024-01-27T15:00:05.430045+0000","last_active":"2024-01-27T15:00:05.430001+0000","last_peered":"2024-01-27T15:00:05.430001+0000","last_clean":"2024-01-27T15:00:05.430001+0000","last_became_active":"2024-01-27T14:31:52.012278+0000","last_became_peered":"2024-01-27T14:31:52.012278+0000","last_unstale":"2024-01-27T15:00:05.430001+0000","last_undegraded":"2024-01-27T15:00:05.430001+0000","last_fullsized":"2024-01-27T15:00:05.430001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-01-27T15:00:05.429893+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-01-27T15:00:05.429893+0000","last_clean_scrub_stamp":"2024-01-27T15:00:05.429893+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:30:34.240966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'34","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:55.804651+0000","last_change":"2024-01-27T14:59:55.804689+0000","last_active":"2024-01-27T14:59:55.804651+0000","last_peered":"2024-01-27T14:59:55.804651+0000","last_clean":"2024-01-27T14:59:55.804651+0000","last_became_active":"2024-01-27T14:31:52.003421+0000","last_became_peered":"2024-01-27T14:31:52.003421+0000","last_unstale":"2024-01-27T14:59:55.804651+0000","last_undegraded":"2024-01-27T14:59:55.804651+0000","last_fullsized":"2024-01-27T14:59:55.804651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-01-27T14:59:55.804548+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-01-27T14:59:55.804548+0000","last_clean_scrub_stamp":"2024-01-27T14:59:55.804548+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:51:01.577818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:06.277903+0000","last_change":"2024-01-27T15:00:06.277925+0000","last_active":"2024-01-27T15:00:06.277903+0000","last_peered":"2024-01-27T15:00:06.277903+0000","last_clean":"2024-01-27T15:00:06.277903+0000","last_became_active":"2024-01-27T14:32:21.651971+0000","last_became_peered":"2024-01-27T14:32:21.651971+0000","last_unstale":"2024-01-27T15:00:06.277903+0000","last_undegraded":"2024-01-27T15:00:06.277903+0000","last_fullsized":"2024-01-27T15:00:06.277903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-01-27T15:00:06.277838+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-01-27T15:00:06.277838+0000","last_clean_scrub_stamp":"2024-01-27T15:00:06.277838+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:42:10.712970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'26","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.781303+0000","last_change":"2024-01-27T14:59:54.781325+0000","last_active":"2024-01-27T14:59:54.781303+0000","last_peered":"2024-01-27T14:59:54.781303+0000","last_clean":"2024-01-27T14:59:54.781303+0000","last_became_active":"2024-01-27T14:31:52.002972+0000","last_became_peered":"2024-01-27T14:31:52.002972+0000","last_unstale":"2024-01-27T14:59:54.781303+0000","last_undegraded":"2024-01-27T14:59:54.781303+0000","last_fullsized":"2024-01-27T14:59:54.781303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2024-01-27T14:59:54.781231+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2024-01-27T14:59:54.781231+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.781231+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:07:39.307178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:54.845974+0000","last_change":"2024-01-27T14:59:54.846010+0000","last_active":"2024-01-27T14:59:54.845974+0000","last_peered":"2024-01-27T14:59:54.845974+0000","last_clean":"2024-01-27T14:59:54.845974+0000","last_became_active":"2024-01-27T14:31:52.003593+0000","last_became_peered":"2024-01-27T14:31:52.003593+0000","last_unstale":"2024-01-27T14:59:54.845974+0000","last_undegraded":"2024-01-27T14:59:54.845974+0000","last_fullsized":"2024-01-27T14:59:54.845974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-01-27T14:59:54.845907+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-01-27T14:59:54.845907+0000","last_clean_scrub_stamp":"2024-01-27T14:59:54.845907+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:41:59.281038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T15:00:08.906228+0000","last_change":"2024-01-27T15:00:08.906264+0000","last_active":"2024-01-27T15:00:08.906228+0000","last_peered":"2024-01-27T15:00:08.906228+0000","last_clean":"2024-01-27T15:00:08.906228+0000","last_became_active":"2024-01-27T14:31:52.009773+0000","last_became_peered":"2024-01-27T14:31:52.009773+0000","last_unstale":"2024-01-27T15:00:08.906228+0000","last_undegraded":"2024-01-27T15:00:08.906228+0000","last_fullsized":"2024-01-27T15:00:08.906228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-01-27T15:00:08.906157+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-01-27T15:00:08.906157+0000","last_clean_scrub_stamp":"2024-01-27T15:00:08.906157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:23:59.323505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-27T14:59:58.417105+0000","last_change":"2024-01-27T14:59:58.417127+0000","last_active":"2024-01-27T14:59:58.417105+0000","last_peered":"2024-01-27T14:59:58.417105+0000","last_clean":"2024-01-27T14:59:58.417105+0000","last_became_active":"2024-01-27T14:31:52.005304+0000","last_became_peered":"2024-01-27T14:31:52.005304+0000","last_unstale":"2024-01-27T14:59:58.417105+0000","last_undegraded":"2024-01-27T14:59:58.417105+0000","last_fullsized":"2024-01-27T14:59:58.417105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-01-27T14:59:58.417040+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-01-27T14:59:58.417040+0000","last_clean_scrub_stamp":"2024-01-27T14:59:58.417040+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:42:29.312782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":317022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4559,"ondisk_log_size":4559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2399,"ondisk_log_size":2399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40258611,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":924,"num_read_kb":993,"num_write":8715,"num_write_kb":44395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80764928,"data_stored":80517222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8352,"ondisk_log_size":8352,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509793,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68584,"kb_used_data":6880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94303256,"statfs":{"total":96636764160,"available":96566534144,"internally_reserved":0,"allocated":7045120,"data_stored":6821501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68300000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.33800000000000002,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.23599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.80100000000000005},"last":0.5}]},{"osd":2,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.307,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.439,"15min":0.434},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.443},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.25},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.76900000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.373,"15min":0.38200000000000001},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.23000000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.621},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.435},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.86399999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Sat Jan 27 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.248},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":0.83299999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509793,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75112,"kb_used_data":13408,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94296728,"statfs":{"total":96636764160,"available":96559849472,"internally_reserved":0,"allocated":13729792,"data_stored":13518196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.30499999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.70899999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.255,"15min":0.23100000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.73899999999999999}]},{"osd":1,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.41299999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.26500000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.441,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.28599999999999998,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.64000000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.433},"min":{"1min":0.36099999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.60499999999999998}]},{"osd":3,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.67900000000000005},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.253},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.71999999999999997},"last":0.433}]},{"osd":6,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Jan 27 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.73699999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.77900000000000003},"last":0.54000000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509792,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61792,"kb_used_data":16728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310048,"statfs":{"total":96636764160,"available":96573489152,"internally_reserved":0,"allocated":17129472,"data_stored":16905624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.312,"15min":0.30599999999999999},"min":{"1min":0.19900000000000001,"5min":0.187,"15min":0.17999999999999999},"max":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.61299999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.314},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.57499999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.313,"15min":0.316},"min":{"1min":0.22500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.67100000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.35299999999999998},"min":{"1min":0.26500000000000001,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.68200000000000005},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.64800000000000002},"last":0.38},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.27300000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.72499999999999998},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.40300000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44500000000000001}]},{"osd":5,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.38500000000000001,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.79500000000000004},"last":0.57999999999999996}]},{"osd":7,"last update":"Sat Jan 27 15:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.76000000000000001},"last":0.56200000000000006}]}]},{"osd":2,"up_from":15,"seq":64424509792,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43844,"kb_used_data":8508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327996,"statfs":{"total":96636764160,"available":96591867904,"internally_reserved":0,"allocated":8712192,"data_stored":8514453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.189,"15min":0.17899999999999999},"max":{"1min":0.45100000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.186},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56599999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":0.47599999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.44}]},{"osd":3,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32200000000000001},"min":{"1min":0.26600000000000001,"5min":0.214,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":0.52900000000000003,"15min":0.54600000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.25},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.313},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.28299999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46899999999999997,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52600000000000002}]},{"osd":6,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Jan 27 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509792,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48588,"kb_used_data":9092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323252,"statfs":{"total":96636764160,"available":96587010048,"internally_reserved":0,"allocated":9310208,"data_stored":9105495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.311,"15min":0.29999999999999999},"min":{"1min":0.191,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.5,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.309},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.311,"15min":0.313},"min":{"1min":0.20999999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49399999999999999,"5min":0.55300000000000005,"15min":0.56399999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.313,"15min":0.307},"min":{"1min":0.20699999999999999,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.191},"max":{"1min":0.628,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.376,"15min":0.36199999999999999},"min":{"1min":0.23499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55400000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.438,"15min":0.432},"min":{"1min":0.307,"5min":0.307,"15min":0.248},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.66000000000000003,"5min":0.749,"15min":0.749},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.748,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47499999999999998,"15min":0.46500000000000002},"min":{"1min":0.372,"5min":0.34899999999999998,"15min":0.28999999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.315},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.62}]},{"osd":7,"last update":"Sat Jan 27 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.72999999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509792,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72400,"kb_used_data":14856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299440,"statfs":{"total":96636764160,"available":96562626560,"internally_reserved":0,"allocated":15212544,"data_stored":14994355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"min":{"1min":0.23200000000000001,"5min":0.20000000000000001,"15min":0.17799999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.318},"min":{"1min":0.217,"5min":0.19500000000000001,"15min":0.16900000000000001},"max":{"1min":0.45700000000000002,"5min":0.58799999999999997,"15min":0.68799999999999994},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.33300000000000002},"min":{"1min":0.23799999999999999,"5min":0.21299999999999999,"15min":0.19},"max":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35199999999999998,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.24099999999999999,"15min":0.223},"max":{"1min":0.46899999999999997,"5min":0.52800000000000002,"15min":0.61399999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.33000000000000002},"min":{"1min":0.253,"5min":0.192,"15min":0.192},"max":{"1min":0.47999999999999998,"5min":0.57199999999999995,"15min":0.58399999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.39000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.35999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.80700000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.372,"5min":0.30099999999999999,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.79500000000000004},"last":0.40899999999999997}]},{"osd":5,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.47499999999999998},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.28999999999999998},"max":{"1min":0.77800000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46600000000000003},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":0.64000000000000001,"15min":0.85399999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.307},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Jan 27 15:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.499},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.88500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46600000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542497,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39752,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332088,"statfs":{"total":96636764160,"available":96596058112,"internally_reserved":0,"allocated":4521984,"data_stored":4322951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.21299999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.23699999999999999},"max":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.70399999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.438,"15min":0.42599999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.317,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41999999999999998,"15min":0.42499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.443,"15min":0.433},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67400000000000004},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Jan 27 15:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61299999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40899999999999997}]},{"osd":5,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.625},"last":0.47999999999999998}]},{"osd":7,"last update":"Sat Jan 27 14:59:45 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.65600000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52300000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542498,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66088,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305752,"statfs":{"total":96636764160,"available":96569090048,"internally_reserved":0,"allocated":8749056,"data_stored":8516223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.65000000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.31900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.67500000000000004},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.67800000000000005,"15min":0.70199999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.63600000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39900000000000002,"15min":0.40300000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.36199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58999999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55200000000000005}]},{"osd":3,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.65300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.442,"15min":0.442},"min":{"1min":0.36599999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.375,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.68700000000000006,"15min":0.68999999999999995},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.622}]},{"osd":7,"last update":"Sat Jan 27 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.24399999999999999},"max":{"1min":0.55600000000000005,"5min":0.65300000000000002,"15min":0.73199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46700000000000003,"15min":0.45100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27300000000000002},"max":{"1min":0.57899999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14905344,"data_stored":14869250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12828672,"data_stored":12802723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":6696396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T15:00:37.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-27T15:00:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.389+0000 7f3930415640 1 Processor -- start 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.389+0000 7f3930415640 1 -- start start 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f3930415640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 0x7f392815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f3930415640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f39280c93b0 0x7f392815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f3930415640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280c7ba0 con 0x7f39280710f0 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f3930415640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3928159a60 con 0x7f39280c93b0 2024-01-27T15:00:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f3930415640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3928159d40 con 0x7f39280714d0 2024-01-27T15:00:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.390+0000 7f392d9b0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 0x7f392815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.391+0000 7f392d9b0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 0x7f392815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43504/0 (socket says 172.21.15.46:43504) 2024-01-27T15:00:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.391+0000 7f392d9b0640 1 -- 172.21.15.46:0/1621111817 learned_addr learned my addr 172.21.15.46:0/1621111817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.391+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1621111817 >> v2:172.21.15.46:3300/0 conn(0x7f39280c93b0 0x7f392815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.395+0000 7f392e9b2640 1 -- 172.21.15.46:0/1621111817 >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 msgr2=0x7f392815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.395+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1621111817 >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 0x7f392815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.395+0000 7f392e9b2640 1 -- 172.21.15.46:0/1621111817 >> v1:172.21.15.46:6789/0 conn(0x7f39280710f0 legacy=0x7f39280ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.395+0000 7f392e9b2640 1 -- 172.21.15.46:0/1621111817 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392815a020 con 0x7f39280c93b0 2024-01-27T15:00:37.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.398+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1621111817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f392815d800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f392806ff70 tx=0x7f392002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d958f5355d23bb server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:37.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.400+0000 7f392d1af640 1 -- 172.21.15.46:0/1621111817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392002cc80 con 0x7f39280c93b0 2024-01-27T15:00:37.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.419+0000 7f392d1af640 1 -- 172.21.15.46:0/1621111817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392002cde0 con 0x7f39280c93b0 2024-01-27T15:00:37.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.419+0000 7f392d1af640 1 -- 172.21.15.46:0/1621111817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920034660 con 0x7f39280c93b0 2024-01-27T15:00:37.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 -- 172.21.15.46:0/1621111817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 msgr2=0x7f392815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 --2- 172.21.15.46:0/1621111817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f392815d800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f392806ff70 tx=0x7f392002bed0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 -- 172.21.15.46:0/1621111817 shutdown_connections 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 --2- 172.21.15.46:0/1621111817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f392815d800 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 --2- 172.21.15.46:0/1621111817 >> v2:172.21.15.73:3300/0 conn(0x7f39280714d0 0x7f392815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 -- 172.21.15.46:0/1621111817 >> 172.21.15.46:0/1621111817 conn(0x7f3928066ac0 msgr2=0x7f392806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 -- 172.21.15.46:0/1621111817 shutdown_connections 2024-01-27T15:00:37.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.420+0000 7f3930415640 1 -- 172.21.15.46:0/1621111817 wait complete. 2024-01-27T15:00:37.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.421+0000 7f3930415640 1 Processor -- start 2024-01-27T15:00:37.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.421+0000 7f3930415640 1 -- start start 2024-01-27T15:00:37.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39280710f0 0x7f39281540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39280714d0 0x7f39280cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280cb600 con 0x7f39280c93b0 2024-01-27T15:00:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39281ef920 con 0x7f39280710f0 2024-01-27T15:00:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f3930415640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39281efe40 con 0x7f39280714d0 2024-01-27T15:00:37.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.422+0000 7f392e9b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.423+0000 7f392e1b1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39280710f0 0x7f39281540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.423+0000 7f392e9b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60462/0 (socket says 172.21.15.46:60462) 2024-01-27T15:00:37.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.423+0000 7f392e9b2640 1 -- 172.21.15.46:0/1141698479 learned_addr learned my addr 172.21.15.46:0/1141698479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:37.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.423+0000 7f392d9b0640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39280714d0 0x7f39280cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.426+0000 7f392e9b2640 1 -- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39280714d0 msgr2=0x7f39280cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.426+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39280714d0 0x7f39280cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.426+0000 7f392e9b2640 1 -- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39280710f0 msgr2=0x7f39281540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:37.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.426+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39280710f0 0x7f39281540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:37.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.426+0000 7f392e9b2640 1 -- 172.21.15.46:0/1141698479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920009a70 con 0x7f39280c93b0 2024-01-27T15:00:37.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.430+0000 7f392e9b2640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3920009e80 tx=0x7f3920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.435+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920040650 con 0x7f39280c93b0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.435+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200407b0 con 0x7f39280c93b0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.435+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39280cb260 con 0x7f39280c93b0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.435+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920040b60 con 0x7f39280c93b0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.435+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39281efb60 con 0x7f39280c93b0 2024-01-27T15:00:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.436+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39280cc040 con 0x7f39280c93b0 2024-01-27T15:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.456+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3920040cc0 con 0x7f39280c93b0 2024-01-27T15:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.457+0000 7f391effd640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 0x7f390c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.457+0000 7f392e1b1640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 0x7f390c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:37.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.457+0000 7f392e1b1640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 0x7f390c06d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39240016e0 tx=0x7f3924009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:37.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.734+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f392007b310 con 0x7f39280c93b0 2024-01-27T15:00:37.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.734+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3920077650 con 0x7f39280c93b0 2024-01-27T15:00:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:37.918+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f39280cb0c0 con 0x7f39280c93b0 2024-01-27T15:00:38.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.014+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f39280cb0c0 con 0x7f39280c93b0 2024-01-27T15:00:38.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.014+0000 7f391effd640 1 -- 172.21.15.46:0/1141698479 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3920077650 con 0x7f39280c93b0 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 msgr2=0x7f390c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 0x7f390c06d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39240016e0 tx=0x7f3924009040 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 msgr2=0x7f39280cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3920009e80 tx=0x7f3920004a40 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 shutdown_connections 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f390c06af20 0x7f390c06d3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39280c93b0 0x7f39280cc730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39280714d0 0x7f39280cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 --2- 172.21.15.46:0/1141698479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39280710f0 0x7f39281540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 >> 172.21.15.46:0/1141698479 conn(0x7f3928066ac0 msgr2=0x7f3928157960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 shutdown_connections 2024-01-27T15:00:38.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.017+0000 7f3930415640 1 -- 172.21.15.46:0/1141698479 wait complete. 2024-01-27T15:00:38.034 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-27T15:00:38.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T15:00:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.136+0000 7f4da5ec2640 1 Processor -- start 2024-01-27T15:00:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.136+0000 7f4da5ec2640 1 -- start start 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4da5ec2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4da00c8080 0x7f4da00c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4da5ec2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 0x7f4da01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4da5ec2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da0158250 con 0x7f4da00c90c0 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4da5ec2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da0158530 con 0x7f4da00c8080 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4da5ec2640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da015ac60 con 0x7f4da00c8460 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4d9ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4da00c90c0 0x7f4da0157670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40656/0 (socket says 172.21.15.46:40656) 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4d9ffff640 1 -- 172.21.15.46:0/916685026 learned_addr learned my addr 172.21.15.46:0/916685026 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4d9f7fe640 1 --2- 172.21.15.46:0/916685026 >> v2:172.21.15.73:3300/0 conn(0x7f4da00c8080 0x7f4da00c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.137+0000 7f4d9effd640 1 --2- 172.21.15.46:0/916685026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 0x7f4da01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9e7fc640 1 -- 172.21.15.46:0/916685026 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593764757 0 0) 0x7f4da0158250 con 0x7f4da00c90c0 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9e7fc640 1 -- 172.21.15.46:0/916685026 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d88003520 con 0x7f4da00c90c0 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9effd640 1 -- 172.21.15.46:0/916685026 >> v2:172.21.15.73:3300/0 conn(0x7f4da00c8080 msgr2=0x7f4da00c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9effd640 1 --2- 172.21.15.46:0/916685026 >> v2:172.21.15.73:3300/0 conn(0x7f4da00c8080 0x7f4da00c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9effd640 1 -- 172.21.15.46:0/916685026 >> v1:172.21.15.46:6789/0 conn(0x7f4da00c90c0 legacy=0x7f4da0157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.140+0000 7f4d9effd640 1 -- 172.21.15.46:0/916685026 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da015af40 con 0x7f4da00c8460 2024-01-27T15:00:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.142+0000 7f4d9effd640 1 --2- 172.21.15.46:0/916685026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 0x7f4da01514e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d9402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed8b5f92fc5630b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:38.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.144+0000 7f4d9e7fc640 1 -- 172.21.15.46:0/916685026 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94031830 con 0x7f4da00c8460 2024-01-27T15:00:38.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.145+0000 7f4d9e7fc640 1 -- 172.21.15.46:0/916685026 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d94031990 con 0x7f4da00c8460 2024-01-27T15:00:38.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.145+0000 7f4d9e7fc640 1 -- 172.21.15.46:0/916685026 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94031d00 con 0x7f4da00c8460 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 -- 172.21.15.46:0/916685026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 msgr2=0x7f4da01514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/916685026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 0x7f4da01514e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d9402b8d0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 -- 172.21.15.46:0/916685026 shutdown_connections 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/916685026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8460 0x7f4da01514e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/916685026 >> v2:172.21.15.73:3300/0 conn(0x7f4da00c8080 0x7f4da00c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 -- 172.21.15.46:0/916685026 >> 172.21.15.46:0/916685026 conn(0x7f4da0070e40 msgr2=0x7f4da0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 -- 172.21.15.46:0/916685026 shutdown_connections 2024-01-27T15:00:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.146+0000 7f4da5ec2640 1 -- 172.21.15.46:0/916685026 wait complete. 2024-01-27T15:00:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.147+0000 7f4da5ec2640 1 Processor -- start 2024-01-27T15:00:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.147+0000 7f4da5ec2640 1 -- start start 2024-01-27T15:00:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 0x7f4da0156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 0x7f4da015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4da00c90c0 0x7f4da0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0158ad0 con 0x7f4da00c8460 2024-01-27T15:00:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00aeb20 con 0x7f4da00c90c0 2024-01-27T15:00:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4da5ec2640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da006ba70 con 0x7f4da00c8080 2024-01-27T15:00:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 0x7f4da015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.148+0000 7f4d9f7fe640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 0x7f4da0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.149+0000 7f4d9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4da00c90c0 0x7f4da0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.149+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 0x7f4da015a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60478/0 (socket says 172.21.15.46:60478) 2024-01-27T15:00:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.149+0000 7f4d9effd640 1 -- 172.21.15.46:0/3530604427 learned_addr learned my addr 172.21.15.46:0/3530604427 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.152+0000 7f4d9f7fe640 1 -- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4da00c90c0 msgr2=0x7f4da0158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.152+0000 7f4d9f7fe640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4da00c90c0 0x7f4da0158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.152+0000 7f4d9f7fe640 1 -- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 msgr2=0x7f4da015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.152+0000 7f4d9f7fe640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 0x7f4da015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.152+0000 7f4d9f7fe640 1 -- 172.21.15.46:0/3530604427 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94009400 con 0x7f4da00c8080 2024-01-27T15:00:38.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.154+0000 7f4d9f7fe640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 0x7f4da0156780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000e880 tx=0x7f4d9000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.158+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000c8e0 con 0x7f4da00c8080 2024-01-27T15:00:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.158+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d9000ca40 con 0x7f4da00c8080 2024-01-27T15:00:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.158+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000ce10 con 0x7f4da00c8080 2024-01-27T15:00:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.158+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da015bba0 con 0x7f4da00c8080 2024-01-27T15:00:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.158+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da00acd20 con 0x7f4da00c8080 2024-01-27T15:00:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.159+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da0158d40 con 0x7f4da00c8080 2024-01-27T15:00:38.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.400+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4d90013470 con 0x7f4da00c8080 2024-01-27T15:00:38.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.401+0000 7f4d87fff640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 0x7f4d8c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.401+0000 7f4d9effd640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 0x7f4d8c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.401+0000 7f4d9effd640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 0x7f4d8c06d410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d9402b910 tx=0x7f4d94008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.404+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4d90058bd0 con 0x7f4da00c8080 2024-01-27T15:00:38.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.414+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4d90054e80 con 0x7f4da00c8080 2024-01-27T15:00:38.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.634+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da00742e0 con 0x7f4da00c8080 2024-01-27T15:00:38.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.647+0000 7f4d87fff640 1 -- 172.21.15.46:0/3530604427 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6578 (secure 0 0 0) 0x7f4d90021020 con 0x7f4da00c8080 2024-01-27T15:00:38.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T15:00:38.649 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:33.202914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253,"mds_3":4250,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T15:00:38.649 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 msgr2=0x7f4d8c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 0x7f4d8c06d410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d9402b910 tx=0x7f4d94008030 comp rx=0 tx=0).stop 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 msgr2=0x7f4da0156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 0x7f4da0156780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000e880 tx=0x7f4d9000ed40 comp rx=0 tx=0).stop 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 shutdown_connections 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f4d8c06af50 0x7f4d8c06d410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4da00c90c0 0x7f4da0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da00c8460 0x7f4da015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 --2- 172.21.15.46:0/3530604427 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4da00c8080 0x7f4da0156780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 >> 172.21.15.46:0/3530604427 conn(0x7f4da0070e40 msgr2=0x7f4da014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:38.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 shutdown_connections 2024-01-27T15:00:38.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.649+0000 7f4da5ec2640 1 -- 172.21.15.46:0/3530604427 wait complete. 2024-01-27T15:00:38.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T15:00:38.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.763+0000 7f5e67d90640 1 Processor -- start 2024-01-27T15:00:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.763+0000 7f5e67d90640 1 -- start start 2024-01-27T15:00:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e67d90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e600cf2c0 0x7f5e600ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e67d90640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e67d90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600b3280 con 0x7f5e60153b00 2024-01-27T15:00:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e67d90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6015a8a0 con 0x7f5e600cf2c0 2024-01-27T15:00:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e67d90640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600caa10 con 0x7f5e600ca600 2024-01-27T15:00:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e6632d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.764+0000 7f5e6532b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e600cf2c0 0x7f5e600ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.765+0000 7f5e6632d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.46:46658/0 (socket says 172.21.15.46:46658) 2024-01-27T15:00:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.765+0000 7f5e6632d640 1 -- 172.21.15.46:0/1580696632 learned_addr learned my addr 172.21.15.46:0/1580696632 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.767+0000 7f5e6632d640 1 -- 172.21.15.46:0/1580696632 >> v2:172.21.15.73:3300/0 conn(0x7f5e600cf2c0 msgr2=0x7f5e600ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.767+0000 7f5e6632d640 1 --2- 172.21.15.46:0/1580696632 >> v2:172.21.15.73:3300/0 conn(0x7f5e600cf2c0 0x7f5e600ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.767+0000 7f5e6632d640 1 -- 172.21.15.46:0/1580696632 >> v1:172.21.15.73:6789/0 conn(0x7f5e60153b00 legacy=0x7f5e600cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.767+0000 7f5e6632d640 1 -- 172.21.15.46:0/1580696632 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6015d0d0 con 0x7f5e600ca600 2024-01-27T15:00:38.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.770+0000 7f5e6632d640 1 --2- 172.21.15.46:0/1580696632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c3da253b3e45417 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.772+0000 7f5e64b2a640 1 -- 172.21.15.46:0/1580696632 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5802cb90 con 0x7f5e600ca600 2024-01-27T15:00:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e64b2a640 1 -- 172.21.15.46:0/1580696632 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e5802ccf0 con 0x7f5e600ca600 2024-01-27T15:00:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e64b2a640 1 -- 172.21.15.46:0/1580696632 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58034630 con 0x7f5e600ca600 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 -- 172.21.15.46:0/1580696632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 msgr2=0x7f5e600b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1580696632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5802bff0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 -- 172.21.15.46:0/1580696632 shutdown_connections 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1580696632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e600ca600 0x7f5e600b3730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1580696632 >> v2:172.21.15.73:3300/0 conn(0x7f5e600cf2c0 0x7f5e600ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 -- 172.21.15.46:0/1580696632 >> 172.21.15.46:0/1580696632 conn(0x7f5e6008b190 msgr2=0x7f5e6008b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 -- 172.21.15.46:0/1580696632 shutdown_connections 2024-01-27T15:00:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.774+0000 7f5e67d90640 1 -- 172.21.15.46:0/1580696632 wait complete. 2024-01-27T15:00:38.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.775+0000 7f5e67d90640 1 Processor -- start 2024-01-27T15:00:38.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 -- start start 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e600cf2c0 0x7f5e60157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e60153b00 0x7f5e6015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e601f30b0 con 0x7f5e600ca600 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014cb20 con 0x7f5e600cf2c0 2024-01-27T15:00:38.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.776+0000 7f5e67d90640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600c7ad0 con 0x7f5e60153b00 2024-01-27T15:00:38.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.777+0000 7f5e65b2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.777+0000 7f5e6632d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e60153b00 0x7f5e6015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.777+0000 7f5e6532b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e600cf2c0 0x7f5e60157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:38.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.777+0000 7f5e65b2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60490/0 (socket says 172.21.15.46:60490) 2024-01-27T15:00:38.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.777+0000 7f5e65b2c640 1 -- 172.21.15.46:0/1391887029 learned_addr learned my addr 172.21.15.46:0/1391887029 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:38.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.780+0000 7f5e65b2c640 1 -- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e60153b00 msgr2=0x7f5e6015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.780+0000 7f5e65b2c640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e60153b00 0x7f5e6015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.781+0000 7f5e65b2c640 1 -- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e600cf2c0 msgr2=0x7f5e60157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:38.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.781+0000 7f5e65b2c640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e600cf2c0 0x7f5e60157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:38.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.781+0000 7f5e65b2c640 1 -- 172.21.15.46:0/1391887029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009b30 con 0x7f5e600ca600 2024-01-27T15:00:38.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.783+0000 7f5e65b2c640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c3f0 tx=0x7f5e5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.787+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0052d0 con 0x7f5e600ca600 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.787+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e5c005450 con 0x7f5e600ca600 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.787+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600c5840 con 0x7f5e600ca600 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.787+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c007280 con 0x7f5e600ca600 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.787+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e600c5560 con 0x7f5e600ca600 2024-01-27T15:00:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:38.788+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e600742e0 con 0x7f5e600ca600 2024-01-27T15:00:39.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.059+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5e5c0073e0 con 0x7f5e600ca600 2024-01-27T15:00:39.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.059+0000 7f5e567fc640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 0x7f5e4406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.059+0000 7f5e6532b640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 0x7f5e4406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.060+0000 7f5e6532b640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 0x7f5e4406d3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e601ecff0 tx=0x7f5e50009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:39.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.074+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5e5c057dc0 con 0x7f5e600ca600 2024-01-27T15:00:39.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.074+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5e5c054100 con 0x7f5e600ca600 2024-01-27T15:00:39.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.298+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e60158c00 con 0x7f5e600ca600 2024-01-27T15:00:39.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.311+0000 7f5e567fc640 1 -- 172.21.15.46:0/1391887029 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6578 (secure 0 0 0) 0x7f5e5c020070 con 0x7f5e600ca600 2024-01-27T15:00:39.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T15:00:39.314 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2424554817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2424554817},{"type":"v1","addr":"172.21.15.46:6835","nonce":2424554817}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T14:31:51.484410+0000","modified":"2024-01-27T14:32:33.202914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4267,"mds_1":4261,"mds_2":4253,"mds_3":4250,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6833/1396170677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1396170677},{"type":"v1","addr":"172.21.15.73:6833","nonce":1396170677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6838/1704137428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6837","nonce":1704137428},{"type":"v1","addr":"172.21.15.46:6838","nonce":1704137428}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.46:6839/1910346878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1910346878},{"type":"v1","addr":"172.21.15.46:6839","nonce":1910346878}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4261":{"gid":4261,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6835/718826535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":718826535},{"type":"v1","addr":"172.21.15.73:6835","nonce":718826535}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4267":{"gid":4267,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/2525471575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2525471575},{"type":"v1","addr":"172.21.15.73:6837","nonce":2525471575}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T15:00:39.314 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-27T15:00:39.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 msgr2=0x7f5e4406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 0x7f5e4406d3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e601ecff0 tx=0x7f5e50009190 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 msgr2=0x7f5e600c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c3f0 tx=0x7f5e5c00c8b0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 shutdown_connections 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f5e4406af20 0x7f5e4406d3e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e600cf2c0 0x7f5e60157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e60153b00 0x7f5e6015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.313+0000 7f5e67d90640 1 --2- 172.21.15.46:0/1391887029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e600ca600 0x7f5e600c7590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.314+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 >> 172.21.15.46:0/1391887029 conn(0x7f5e6008b190 msgr2=0x7f5e600caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.314+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 shutdown_connections 2024-01-27T15:00:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.314+0000 7f5e67d90640 1 -- 172.21.15.46:0/1391887029 wait complete. 2024-01-27T15:00:39.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T15:00:39.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.427+0000 7fd2e14ec640 1 Processor -- start 2024-01-27T15:00:39.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.427+0000 7fd2e14ec640 1 -- start start 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2e14ec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 0x7fd2dc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2e14ec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2dc0cd360 0x7fd2dc06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2e14ec640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc153e10 con 0x7fd2dc06c460 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2e14ec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc06ba90 con 0x7fd2dc0cd360 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2e14ec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc15cce0 con 0x7fd2dc153a30 2024-01-27T15:00:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.428+0000 7fd2da7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2dc0cd360 0x7fd2dc06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.429+0000 7fd2daffd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 0x7fd2dc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.429+0000 7fd2db7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd2dc06c460 0x7fd2dc159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40666/0 (socket says 172.21.15.46:40666) 2024-01-27T15:00:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.429+0000 7fd2db7fe640 1 -- 172.21.15.46:0/3002576987 learned_addr learned my addr 172.21.15.46:0/3002576987 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.431+0000 7fd2daffd640 1 -- 172.21.15.46:0/3002576987 >> v2:172.21.15.46:3300/0 conn(0x7fd2dc0cd360 msgr2=0x7fd2dc06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.431+0000 7fd2daffd640 1 --2- 172.21.15.46:0/3002576987 >> v2:172.21.15.46:3300/0 conn(0x7fd2dc0cd360 0x7fd2dc06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.431+0000 7fd2daffd640 1 -- 172.21.15.46:0/3002576987 >> v1:172.21.15.46:6789/0 conn(0x7fd2dc06c460 legacy=0x7fd2dc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.431+0000 7fd2daffd640 1 -- 172.21.15.46:0/3002576987 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc06c8c0 con 0x7fd2dc153a30 2024-01-27T15:00:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.433+0000 7fd2daffd640 1 --2- 172.21.15.46:0/3002576987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 0x7fd2dc0cce20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097a0 tx=0x7fd2c402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2252f304de56334e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2d9ffb640 1 -- 172.21.15.46:0/3002576987 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4030610 con 0x7fd2dc153a30 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2d9ffb640 1 -- 172.21.15.46:0/3002576987 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd2c4030770 con 0x7fd2dc153a30 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2d9ffb640 1 -- 172.21.15.46:0/3002576987 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4030b20 con 0x7fd2dc153a30 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 -- 172.21.15.46:0/3002576987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 msgr2=0x7fd2dc0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/3002576987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 0x7fd2dc0cce20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097a0 tx=0x7fd2c402b960 comp rx=0 tx=0).stop 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 -- 172.21.15.46:0/3002576987 shutdown_connections 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/3002576987 >> v2:172.21.15.46:3300/0 conn(0x7fd2dc0cd360 0x7fd2dc06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/3002576987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc153a30 0x7fd2dc0cce20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 -- 172.21.15.46:0/3002576987 >> 172.21.15.46:0/3002576987 conn(0x7fd2dc06a6c0 msgr2=0x7fd2dc06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 -- 172.21.15.46:0/3002576987 shutdown_connections 2024-01-27T15:00:39.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.440+0000 7fd2e14ec640 1 -- 172.21.15.46:0/3002576987 wait complete. 2024-01-27T15:00:39.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 Processor -- start 2024-01-27T15:00:39.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 -- start start 2024-01-27T15:00:39.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2dc06c460 0x7fd2dc1e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc0cd360 0x7fd2dc1f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1ef6a0 con 0x7fd2dc153a30 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc14ecb0 con 0x7fd2dc06c460 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.442+0000 7fd2e14ec640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1f3b60 con 0x7fd2dc0cd360 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.443+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.443+0000 7fd2daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2dc06c460 0x7fd2dc1e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.443+0000 7fd2da7fc640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc0cd360 0x7fd2dc1f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.443+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60508/0 (socket says 172.21.15.46:60508) 2024-01-27T15:00:39.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.443+0000 7fd2db7fe640 1 -- 172.21.15.46:0/881995443 learned_addr learned my addr 172.21.15.46:0/881995443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:39.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.447+0000 7fd2db7fe640 1 -- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc0cd360 msgr2=0x7fd2dc1f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.447+0000 7fd2db7fe640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc0cd360 0x7fd2dc1f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.447+0000 7fd2db7fe640 1 -- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2dc06c460 msgr2=0x7fd2dc1e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.447+0000 7fd2db7fe640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2dc06c460 0x7fd2dc1e5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.447+0000 7fd2db7fe640 1 -- 172.21.15.46:0/881995443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4009400 con 0x7fd2dc153a30 2024-01-27T15:00:39.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.449+0000 7fd2db7fe640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400cbf0 tx=0x7fd2d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:39.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.453+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400ace0 con 0x7fd2dc153a30 2024-01-27T15:00:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.453+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd2d400ae40 con 0x7fd2dc153a30 2024-01-27T15:00:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.453+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc1f32c0 con 0x7fd2dc153a30 2024-01-27T15:00:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.453+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4012620 con 0x7fd2dc153a30 2024-01-27T15:00:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.453+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc1f3880 con 0x7fd2dc153a30 2024-01-27T15:00:39.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.454+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc06d960 con 0x7fd2dc153a30 2024-01-27T15:00:39.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.473+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd2d4007070 con 0x7fd2dc153a30 2024-01-27T15:00:39.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.474+0000 7fd2d37fe640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 0x7fd2bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:39.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.474+0000 7fd2daffd640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 0x7fd2bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:39.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.474+0000 7fd2daffd640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 0x7fd2bc06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4036000 tx=0x7fd2c403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.478+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd2d40585c0 con 0x7fd2dc153a30 2024-01-27T15:00:39.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.735+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd2d4054900 con 0x7fd2dc153a30 2024-01-27T15:00:39.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.915+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2dc0742e0 con 0x7fd2dc153a30 2024-01-27T15:00:39.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.957+0000 7fd2d37fe640 1 -- 172.21.15.46:0/881995443 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18444 (secure 0 0 0) 0x7fd2d4017090 con 0x7fd2dc153a30 2024-01-27T15:00:39.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T15:00:39.959 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"fsid":"00cf821c-af7b-4286-9602-7ecfadc2291e","created":"2024-01-27T14:31:13.303005+0000","modified":"2024-01-27T14:32:21.198377+0000","last_up_change":"2024-01-27T14:31:28.828884+0000","last_in_change":"2024-01-27T14:31:19.133133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T14:31:29.304882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T14:31:49.122080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T14:31:50.280316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T14:31:55.515914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05ee0cd1-394a-44de-9fed-1d79720d58cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6806","nonce":4069301079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6812","nonce":4069301079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6823","nonce":4069301079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":4069301079},{"type":"v1","addr":"172.21.15.46:6818","nonce":4069301079}]},"public_addr":"172.21.15.46:6806/4069301079","cluster_addr":"172.21.15.46:6812/4069301079","heartbeat_back_addr":"172.21.15.46:6823/4069301079","heartbeat_front_addr":"172.21.15.46:6818/4069301079","state":["exists","up"]},{"osd":1,"uuid":"abfc146b-b77e-4c85-880a-b129f6dd3e0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6804","nonce":1737720199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6810","nonce":1737720199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6822","nonce":1737720199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":1737720199},{"type":"v1","addr":"172.21.15.46:6816","nonce":1737720199}]},"public_addr":"172.21.15.46:6804/1737720199","cluster_addr":"172.21.15.46:6810/1737720199","heartbeat_back_addr":"172.21.15.46:6822/1737720199","heartbeat_front_addr":"172.21.15.46:6816/1737720199","state":["exists","up"]},{"osd":2,"uuid":"2ac7df3f-553a-4e14-bc2c-3e79c650baca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6808","nonce":3503918932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6814","nonce":3503918932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6825","nonce":3503918932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3503918932},{"type":"v1","addr":"172.21.15.46:6820","nonce":3503918932}]},"public_addr":"172.21.15.46:6808/3503918932","cluster_addr":"172.21.15.46:6814/3503918932","heartbeat_back_addr":"172.21.15.46:6825/3503918932","heartbeat_front_addr":"172.21.15.46:6820/3503918932","state":["exists","up"]},{"osd":3,"uuid":"dd39dbb2-e1ff-4998-aeb1-131545d5af1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6827","nonce":2789936740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6829","nonce":2789936740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6833","nonce":2789936740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2789936740},{"type":"v1","addr":"172.21.15.46:6831","nonce":2789936740}]},"public_addr":"172.21.15.46:6827/2789936740","cluster_addr":"172.21.15.46:6829/2789936740","heartbeat_back_addr":"172.21.15.46:6833/2789936740","heartbeat_front_addr":"172.21.15.46:6831/2789936740","state":["exists","up"]},{"osd":4,"uuid":"1cb39a57-de30-4de9-96c2-6e2af62ac9a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6809","nonce":348968633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6811","nonce":348968633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6815","nonce":348968633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":348968633},{"type":"v1","addr":"172.21.15.73:6813","nonce":348968633}]},"public_addr":"172.21.15.73:6809/348968633","cluster_addr":"172.21.15.73:6811/348968633","heartbeat_back_addr":"172.21.15.73:6815/348968633","heartbeat_front_addr":"172.21.15.73:6813/348968633","state":["exists","up"]},{"osd":5,"uuid":"dba0b812-1b4e-4892-9f39-4fd1ff589c4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6817","nonce":276149811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6819","nonce":276149811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6823","nonce":276149811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":276149811},{"type":"v1","addr":"172.21.15.73:6821","nonce":276149811}]},"public_addr":"172.21.15.73:6817/276149811","cluster_addr":"172.21.15.73:6819/276149811","heartbeat_back_addr":"172.21.15.73:6823/276149811","heartbeat_front_addr":"172.21.15.73:6821/276149811","state":["exists","up"]},{"osd":6,"uuid":"822d4e46-972c-4034-9089-8ae0417aac49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6801","nonce":71356255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6803","nonce":71356255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6807","nonce":71356255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":71356255},{"type":"v1","addr":"172.21.15.73:6805","nonce":71356255}]},"public_addr":"172.21.15.73:6801/71356255","cluster_addr":"172.21.15.73:6803/71356255","heartbeat_back_addr":"172.21.15.73:6807/71356255","heartbeat_front_addr":"172.21.15.73:6805/71356255","state":["exists","up"]},{"osd":7,"uuid":"0fe330fa-b80a-4aa9-99a9-cbbee492ec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6825","nonce":944085099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6827","nonce":944085099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6831","nonce":944085099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":944085099},{"type":"v1","addr":"172.21.15.73:6829","nonce":944085099}]},"public_addr":"172.21.15.73:6825/944085099","cluster_addr":"172.21.15.73:6827/944085099","heartbeat_back_addr":"172.21.15.73:6831/944085099","heartbeat_front_addr":"172.21.15.73:6829/944085099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.715662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.694063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.729964+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.646723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.700756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.636792+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T14:31:24.711493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":7,"to":4}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 msgr2=0x7fd2bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 0x7fd2bc06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4036000 tx=0x7fd2c403b040 comp rx=0 tx=0).stop 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 msgr2=0x7fd2dc14b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400cbf0 tx=0x7fd2d400a430 comp rx=0 tx=0).stop 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 shutdown_connections 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fd2bc06aed0 0x7fd2bc06d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2dc153a30 0x7fd2dc14b4d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2dc0cd360 0x7fd2dc1f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 --2- 172.21.15.46:0/881995443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2dc06c460 0x7fd2dc1e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 >> 172.21.15.46:0/881995443 conn(0x7fd2dc06a6c0 msgr2=0x7fd2dc151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 shutdown_connections 2024-01-27T15:00:39.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:39.959+0000 7fd2e14ec640 1 -- 172.21.15.46:0/881995443 wait complete. 2024-01-27T15:00:39.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-27T15:00:40.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.075+0000 7fae8291d640 1 Processor -- start 2024-01-27T15:00:40.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.075+0000 7fae8291d640 1 -- start start 2024-01-27T15:00:40.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.076+0000 7fae8291d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae7c0710f0 0x7fae7c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.076+0000 7fae8291d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 0x7fae7c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.076+0000 7fae8291d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c0ca870 con 0x7fae7c0c93b0 2024-01-27T15:00:40.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.076+0000 7fae8291d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0c7ba0 con 0x7fae7c0714d0 2024-01-27T15:00:40.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.076+0000 7fae8291d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c159a60 con 0x7fae7c0710f0 2024-01-27T15:00:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.077+0000 7fae7b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 0x7fae7c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.077+0000 7fae7bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae7c0710f0 0x7fae7c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.077+0000 7fae7b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 0x7fae7c15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60518/0 (socket says 172.21.15.46:60518) 2024-01-27T15:00:40.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.077+0000 7fae7b7fe640 1 -- 172.21.15.46:0/1735702679 learned_addr learned my addr 172.21.15.46:0/1735702679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:40.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.080+0000 7fae7bfff640 1 -- 172.21.15.46:0/1735702679 >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 msgr2=0x7fae7c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:40.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.080+0000 7fae7bfff640 1 --2- 172.21.15.46:0/1735702679 >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 0x7fae7c15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.080+0000 7fae7bfff640 1 -- 172.21.15.46:0/1735702679 >> v1:172.21.15.46:6789/0 conn(0x7fae7c0c93b0 legacy=0x7fae7c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.080+0000 7fae7bfff640 1 -- 172.21.15.46:0/1735702679 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c159d40 con 0x7fae7c0710f0 2024-01-27T15:00:40.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.082+0000 7fae7bfff640 1 --2- 172.21.15.46:0/1735702679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c0ca330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06d9b0 tx=0x7fae7002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ae009afc9b8eea1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:40.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae7affd640 1 -- 172.21.15.46:0/1735702679 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70030610 con 0x7fae7c0710f0 2024-01-27T15:00:40.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae7affd640 1 -- 172.21.15.46:0/1735702679 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae70030770 con 0x7fae7c0710f0 2024-01-27T15:00:40.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae7affd640 1 -- 172.21.15.46:0/1735702679 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70030b20 con 0x7fae7c0710f0 2024-01-27T15:00:40.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 -- 172.21.15.46:0/1735702679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 msgr2=0x7fae7c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 --2- 172.21.15.46:0/1735702679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c0ca330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06d9b0 tx=0x7fae7002b960 comp rx=0 tx=0).stop 2024-01-27T15:00:40.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 -- 172.21.15.46:0/1735702679 shutdown_connections 2024-01-27T15:00:40.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 --2- 172.21.15.46:0/1735702679 >> v2:172.21.15.46:3300/0 conn(0x7fae7c0714d0 0x7fae7c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 --2- 172.21.15.46:0/1735702679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c0ca330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 -- 172.21.15.46:0/1735702679 >> 172.21.15.46:0/1735702679 conn(0x7fae7c066ac0 msgr2=0x7fae7c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 -- 172.21.15.46:0/1735702679 shutdown_connections 2024-01-27T15:00:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.087+0000 7fae8291d640 1 -- 172.21.15.46:0/1735702679 wait complete. 2024-01-27T15:00:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.088+0000 7fae8291d640 1 Processor -- start 2024-01-27T15:00:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 -- start start 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae7c0c93b0 0x7fae7c1e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1eff80 con 0x7fae7c0714d0 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c14e900 con 0x7fae7c0710f0 2024-01-27T15:00:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.089+0000 7fae8291d640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1ef200 con 0x7fae7c0c93b0 2024-01-27T15:00:40.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.090+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.090+0000 7fae7bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.090+0000 7fae80eba640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae7c0c93b0 0x7fae7c1e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.090+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60532/0 (socket says 172.21.15.46:60532) 2024-01-27T15:00:40.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.090+0000 7fae7b7fe640 1 -- 172.21.15.46:0/3723224189 learned_addr learned my addr 172.21.15.46:0/3723224189 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:40.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.093+0000 7fae7b7fe640 1 -- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae7c0c93b0 msgr2=0x7fae7c1e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.093+0000 7fae7b7fe640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae7c0c93b0 0x7fae7c1e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.093+0000 7fae7b7fe640 1 -- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 msgr2=0x7fae7c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.093+0000 7fae7b7fe640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.093+0000 7fae7b7fe640 1 -- 172.21.15.46:0/3723224189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009400 con 0x7fae7c0714d0 2024-01-27T15:00:40.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.096+0000 7fae7b7fe640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e900 tx=0x7fae6c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.099+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00ca00 con 0x7fae7c0714d0 2024-01-27T15:00:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.099+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae6c00cb60 con 0x7fae7c0714d0 2024-01-27T15:00:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.099+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c013470 con 0x7fae7c0714d0 2024-01-27T15:00:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.099+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c152f90 con 0x7fae7c0714d0 2024-01-27T15:00:40.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.099+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c1ef4a0 con 0x7fae7c0714d0 2024-01-27T15:00:40.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.100+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0742e0 con 0x7fae7c0714d0 2024-01-27T15:00:40.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.364+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fae6c0135d0 con 0x7fae7c0714d0 2024-01-27T15:00:40.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.365+0000 7fae78ff9640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 0x7fae6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.365+0000 7fae7bfff640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 0x7fae6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.365+0000 7fae7bfff640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 0x7fae6806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae70036000 tx=0x7fae70008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.378+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fae6c058d60 con 0x7fae7c0714d0 2024-01-27T15:00:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.378+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fae6c055010 con 0x7fae7c0714d0 2024-01-27T15:00:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.605+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fae7c15a5d0 con 0x7fae7c0714d0 2024-01-27T15:00:40.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.680+0000 7fae78ff9640 1 -- 172.21.15.46:0/3723224189 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae6c021020 con 0x7fae7c0714d0 2024-01-27T15:00:40.682 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 msgr2=0x7fae6806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 0x7fae6806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae70036000 tx=0x7fae70008030 comp rx=0 tx=0).stop 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 msgr2=0x7fae7c14dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e900 tx=0x7fae6c00edc0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 shutdown_connections 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fae6806aed0 0x7fae6806d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae7c0c93b0 0x7fae7c1e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae7c0714d0 0x7fae7c14dd00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 --2- 172.21.15.46:0/3723224189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0710f0 0x7fae7c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 >> 172.21.15.46:0/3723224189 conn(0x7fae7c066ac0 msgr2=0x7fae7c153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 shutdown_connections 2024-01-27T15:00:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.682+0000 7fae8291d640 1 -- 172.21.15.46:0/3723224189 wait complete. 2024-01-27T15:00:40.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-27T15:00:40.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.807+0000 7ff5ff9de640 1 Processor -- start 2024-01-27T15:00:40.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.808+0000 7ff5ff9de640 1 -- start start 2024-01-27T15:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.809+0000 7ff5ff9de640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 0x7ff5f815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.809+0000 7ff5ff9de640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f808af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.809+0000 7ff5ff9de640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80ca820 con 0x7ff5f808b4a0 2024-01-27T15:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.809+0000 7ff5ff9de640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80ca3d0 con 0x7ff5f8153b60 2024-01-27T15:00:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.809+0000 7ff5ff9de640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80c9e10 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.810+0000 7ff5fd77a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 0x7ff5f815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.810+0000 7ff5fcf79640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f808af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.810+0000 7ff5fd77a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 0x7ff5f815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60536/0 (socket says 172.21.15.46:60536) 2024-01-27T15:00:40.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.810+0000 7ff5fd77a640 1 -- 172.21.15.46:0/880245226 learned_addr learned my addr 172.21.15.46:0/880245226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:40.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.813+0000 7ff5fcf79640 1 -- 172.21.15.46:0/880245226 >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 msgr2=0x7ff5f815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:40.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.813+0000 7ff5fcf79640 1 --2- 172.21.15.46:0/880245226 >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 0x7ff5f815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.813+0000 7ff5fcf79640 1 -- 172.21.15.46:0/880245226 >> v1:172.21.15.46:6789/0 conn(0x7ff5f808b4a0 legacy=0x7ff5f815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.813+0000 7ff5fcf79640 1 -- 172.21.15.46:0/880245226 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80ca0f0 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.815+0000 7ff5fcf79640 1 --2- 172.21.15.46:0/880245226 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f808af60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097a0 tx=0x7ff5e802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eb2c6721b3bbece server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:40.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.819+0000 7ff5effff640 1 -- 172.21.15.46:0/880245226 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8031830 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.820+0000 7ff5effff640 1 -- 172.21.15.46:0/880245226 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5e8031990 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.820+0000 7ff5effff640 1 -- 172.21.15.46:0/880245226 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8031d40 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.820+0000 7ff5ff9de640 1 -- 172.21.15.46:0/880245226 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 msgr2=0x7ff5f808af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.820+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/880245226 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f808af60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097a0 tx=0x7ff5e802b8d0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.820+0000 7ff5ff9de640 1 -- 172.21.15.46:0/880245226 shutdown_connections 2024-01-27T15:00:40.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.821+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/880245226 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f808af60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.821+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/880245226 >> v2:172.21.15.46:3300/0 conn(0x7ff5f8153b60 0x7ff5f815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.821+0000 7ff5ff9de640 1 -- 172.21.15.46:0/880245226 >> 172.21.15.46:0/880245226 conn(0x7ff5f8071df0 msgr2=0x7ff5f8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:40.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.821+0000 7ff5ff9de640 1 -- 172.21.15.46:0/880245226 shutdown_connections 2024-01-27T15:00:40.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.821+0000 7ff5ff9de640 1 -- 172.21.15.46:0/880245226 wait complete. 2024-01-27T15:00:40.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.822+0000 7ff5ff9de640 1 Processor -- start 2024-01-27T15:00:40.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.823+0000 7ff5ff9de640 1 -- start start 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f8153b60 0x7ff5f8151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f81f2e30 con 0x7ff5f808b4a0 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f81e0450 con 0x7ff5f8153b60 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5ff9de640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80c4de0 con 0x7ff5f80cbdf0 2024-01-27T15:00:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5fd77a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.824+0000 7ff5fcf79640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:40.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.825+0000 7ff5fd77a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60546/0 (socket says 172.21.15.46:60546) 2024-01-27T15:00:40.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.825+0000 7ff5fd77a640 1 -- 172.21.15.46:0/99464179 learned_addr learned my addr 172.21.15.46:0/99464179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.828+0000 7ff5fd77a640 1 -- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 msgr2=0x7ff5f814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.828+0000 7ff5fd77a640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.828+0000 7ff5fd77a640 1 -- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f8153b60 msgr2=0x7ff5f8151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.828+0000 7ff5fd77a640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f8153b60 0x7ff5f8151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:40.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.828+0000 7ff5fd77a640 1 -- 172.21.15.46:0/99464179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009400 con 0x7ff5f808b4a0 2024-01-27T15:00:40.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.831+0000 7ff5fd77a640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400e870 tx=0x7ff5f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:40.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.836+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400c8e0 con 0x7ff5f808b4a0 2024-01-27T15:00:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.836+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5f400ca40 con 0x7ff5f808b4a0 2024-01-27T15:00:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.836+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80cf630 con 0x7ff5f808b4a0 2024-01-27T15:00:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.836+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400ce10 con 0x7ff5f808b4a0 2024-01-27T15:00:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.836+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f80cf8f0 con 0x7ff5f808b4a0 2024-01-27T15:00:40.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:40.837+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f80742e0 con 0x7ff5f808b4a0 2024-01-27T15:00:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.122+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff5f4013470 con 0x7ff5f808b4a0 2024-01-27T15:00:41.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.123+0000 7ff5edffb640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 0x7ff5dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:41.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.123+0000 7ff5fcf79640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 0x7ff5dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:41.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.123+0000 7ff5fcf79640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 0x7ff5dc06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8036000 tx=0x7ff5e803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:41.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.137+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7006+0+0 (secure 0 0 0) 0x7ff5f4058be0 con 0x7ff5f808b4a0 2024-01-27T15:00:41.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.137+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff5f4054f20 con 0x7ff5f808b4a0 2024-01-27T15:00:41.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:41.361+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff5f80ca9e0 con 0x7ff5f808b4a0 2024-01-27T15:00:41.831 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:00:29:05.412 42666== 2024-01-27T15:00:41.831 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:00:29:05.412 42666== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:00:41.845 INFO:tasks.ceph.mds.a.smithi046.stderr:==00:00:29:05.431 42373== 2024-01-27T15:00:41.845 INFO:tasks.ceph.mds.a.smithi046.stderr:==00:00:29:05.431 42373== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:00:41.873 INFO:tasks.ceph.mds.c.smithi046.stderr:==00:00:29:05.459 42372== 2024-01-27T15:00:41.873 INFO:tasks.ceph.mds.c.smithi046.stderr:==00:00:29:05.459 42372== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:00:41.937 INFO:tasks.ceph.mds.a.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:00:41.937 INFO:tasks.ceph.mds.c.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:00:41.984 INFO:tasks.ceph.mds.d.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:00:42.014 INFO:tasks.ceph.mds.b.smithi073.stderr:==00:00:29:05.596 42665== 2024-01-27T15:00:42.014 INFO:tasks.ceph.mds.b.smithi073.stderr:==00:00:29:05.596 42665== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:00:42.048 INFO:tasks.ceph.mds.f.smithi073.stderr:==00:00:29:05.623 42667== 2024-01-27T15:00:42.048 INFO:tasks.ceph.mds.f.smithi073.stderr:==00:00:29:05.623 42667== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:00:42.183 INFO:tasks.ceph.mds.b.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:00:42.184 INFO:tasks.ceph.mds.f.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:00:42.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.379+0000 7ff5edffb640 1 -- 172.21.15.46:0/99464179 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5f40210a0 con 0x7ff5f808b4a0 2024-01-27T15:00:42.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 msgr2=0x7ff5dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 0x7ff5dc06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8036000 tx=0x7ff5e803c040 comp rx=0 tx=0).stop 2024-01-27T15:00:42.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 msgr2=0x7ff5f81f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400e870 tx=0x7ff5f400ed30 comp rx=0 tx=0).stop 2024-01-27T15:00:42.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 shutdown_connections 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7ff5dc06aed0 0x7ff5dc06d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f8153b60 0x7ff5f8151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5f80cbdf0 0x7ff5f814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 --2- 172.21.15.46:0/99464179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f808b4a0 0x7ff5f81f3250 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 >> 172.21.15.46:0/99464179 conn(0x7ff5f8071df0 msgr2=0x7ff5f80cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 shutdown_connections 2024-01-27T15:00:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.381+0000 7ff5ff9de640 1 -- 172.21.15.46:0/99464179 wait complete. 2024-01-27T15:00:42.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-27T15:00:42.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.499+0000 7fb89abe5640 1 Processor -- start 2024-01-27T15:00:42.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.500+0000 7fb89abe5640 1 -- start start 2024-01-27T15:00:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.500+0000 7fb89abe5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb8941518d0 0x7fb8940c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.500+0000 7fb89abe5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8940c7510 con 0x7fb8940ccc00 2024-01-27T15:00:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.500+0000 7fb89abe5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb894158300 con 0x7fb8940c6f20 2024-01-27T15:00:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.500+0000 7fb89abe5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8940c77b0 con 0x7fb8941518d0 2024-01-27T15:00:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.501+0000 7fb893fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb8940ccc00 0x7fb8940c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40696/0 (socket says 172.21.15.46:40696) 2024-01-27T15:00:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.501+0000 7fb893fff640 1 -- 172.21.15.46:0/155431829 learned_addr learned my addr 172.21.15.46:0/155431829 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.501+0000 7fb898981640 1 --2- 172.21.15.46:0/155431829 >> v2:172.21.15.73:3300/0 conn(0x7fb8941518d0 0x7fb8940c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.504+0000 7fb8937fe640 1 -- 172.21.15.46:0/155431829 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934533748 0 0) 0x7fb8940c7510 con 0x7fb8940ccc00 2024-01-27T15:00:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.504+0000 7fb8937fe640 1 -- 172.21.15.46:0/155431829 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb884003520 con 0x7fb8940ccc00 2024-01-27T15:00:42.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.505+0000 7fb898981640 1 -- 172.21.15.46:0/155431829 >> v1:172.21.15.73:6789/0 conn(0x7fb8940c6f20 legacy=0x7fb89406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.505+0000 7fb898981640 1 -- 172.21.15.46:0/155431829 >> v1:172.21.15.46:6789/0 conn(0x7fb8940ccc00 legacy=0x7fb8940c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.505+0000 7fb898981640 1 -- 172.21.15.46:0/155431829 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940c7a90 con 0x7fb8941518d0 2024-01-27T15:00:42.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.508+0000 7fb898981640 1 --2- 172.21.15.46:0/155431829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8940c6980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097a0 tx=0x7fb88802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16992010e3e1e95 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:42.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.512+0000 7fb8937fe640 1 -- 172.21.15.46:0/155431829 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88802f810 con 0x7fb8941518d0 2024-01-27T15:00:42.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.512+0000 7fb8937fe640 1 -- 172.21.15.46:0/155431829 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb88802f970 con 0x7fb8941518d0 2024-01-27T15:00:42.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.512+0000 7fb8937fe640 1 -- 172.21.15.46:0/155431829 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88802fd20 con 0x7fb8941518d0 2024-01-27T15:00:42.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 -- 172.21.15.46:0/155431829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 msgr2=0x7fb8940c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 --2- 172.21.15.46:0/155431829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8940c6980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097a0 tx=0x7fb88802b9f0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 -- 172.21.15.46:0/155431829 shutdown_connections 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 --2- 172.21.15.46:0/155431829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8940c6980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 -- 172.21.15.46:0/155431829 >> 172.21.15.46:0/155431829 conn(0x7fb8940cbf80 msgr2=0x7fb8940cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 -- 172.21.15.46:0/155431829 shutdown_connections 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.513+0000 7fb89abe5640 1 -- 172.21.15.46:0/155431829 wait complete. 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.514+0000 7fb89abe5640 1 Processor -- start 2024-01-27T15:00:42.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.514+0000 7fb89abe5640 1 -- start start 2024-01-27T15:00:42.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 0x7fb89406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940ccc00 0x7fb8941f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c0fa0 con 0x7fb8940c6f20 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894145830 con 0x7fb8941518d0 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.515+0000 7fb89abe5640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89406e300 con 0x7fb8940ccc00 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.516+0000 7fb899182640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.516+0000 7fb898981640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 0x7fb89406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.516+0000 7fb893fff640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940ccc00 0x7fb8941f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.516+0000 7fb899182640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.46:43570/0 (socket says 172.21.15.46:43570) 2024-01-27T15:00:42.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.516+0000 7fb899182640 1 -- 172.21.15.46:0/3071890352 learned_addr learned my addr 172.21.15.46:0/3071890352 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:42.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb899182640 1 -- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940ccc00 msgr2=0x7fb8941f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb899182640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940ccc00 0x7fb8941f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb899182640 1 -- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 msgr2=0x7fb89406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:42.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb899182640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 0x7fb89406eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb899182640 1 -- 172.21.15.46:0/3071890352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888009400 con 0x7fb8941518d0 2024-01-27T15:00:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.519+0000 7fb898981640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 0x7fb89406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T15:00:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.522+0000 7fb899182640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c730 tx=0x7fb88c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.526+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c003b70 con 0x7fb8941518d0 2024-01-27T15:00:42.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.526+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb88c003cd0 con 0x7fb8941518d0 2024-01-27T15:00:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.526+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00aab0 con 0x7fb8941518d0 2024-01-27T15:00:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.526+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb894143130 con 0x7fb8941518d0 2024-01-27T15:00:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.526+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb894145550 con 0x7fb8941518d0 2024-01-27T15:00:42.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.527+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89406eac0 con 0x7fb8941518d0 2024-01-27T15:00:42.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.546+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb88c00ac10 con 0x7fb8941518d0 2024-01-27T15:00:42.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.546+0000 7fb8917fa640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 0x7fb87806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:42.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.547+0000 7fb898981640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 0x7fb87806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:42.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.547+0000 7fb898981640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 0x7fb87806d3e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb888036000 tx=0x7fb888008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:42.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.771+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7006+0+0 (secure 0 0 0) 0x7fb88c00ce40 con 0x7fb8941518d0 2024-01-27T15:00:42.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.780+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb88c054c20 con 0x7fb8941518d0 2024-01-27T15:00:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:42.962+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb89406eac0 con 0x7fb8941518d0 2024-01-27T15:00:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.554+0000 7fb8917fa640 1 -- 172.21.15.46:0/3071890352 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb89406eac0 con 0x7fb8941518d0 2024-01-27T15:00:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-01-27T15:00:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 msgr2=0x7fb87806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 0x7fb87806d3e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb888036000 tx=0x7fb888008030 comp rx=0 tx=0).stop 2024-01-27T15:00:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 msgr2=0x7fb8941f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c730 tx=0x7fb88c00cbf0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 shutdown_connections 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7fb87806af20 0x7fb87806d3e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8941518d0 0x7fb8941f2d40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940ccc00 0x7fb8941f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 --2- 172.21.15.46:0/3071890352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8940c6f20 0x7fb89406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.555+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 >> 172.21.15.46:0/3071890352 conn(0x7fb8940cbf80 msgr2=0x7fb894073b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.556+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 shutdown_connections 2024-01-27T15:00:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.556+0000 7fb89abe5640 1 -- 172.21.15.46:0/3071890352 wait complete. 2024-01-27T15:00:43.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-27T15:00:43.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.673+0000 7f86b2831640 1 Processor -- start 2024-01-27T15:00:43.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.673+0000 7f86b2831640 1 -- start start 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.674+0000 7f86b2831640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86ac153c40 0x7f86ac06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.674+0000 7f86b2831640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac15d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.674+0000 7f86b2831640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac15a750 con 0x7f86ac06f2d0 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.674+0000 7f86b2831640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0c1a80 con 0x7f86ac153c40 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.674+0000 7f86b2831640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac15da90 con 0x7f86ac15d120 2024-01-27T15:00:43.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.675+0000 7f86b0dce640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.675+0000 7f86abfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86ac153c40 0x7f86ac06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.675+0000 7f86ab7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86ac06f2d0 0x7f86ac0c2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:58704/0 (socket says 172.21.15.46:58704) 2024-01-27T15:00:43.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.675+0000 7f86ab7fe640 1 -- 172.21.15.46:0/3818050976 learned_addr learned my addr 172.21.15.46:0/3818050976 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:43.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.678+0000 7f86b0dce640 1 -- 172.21.15.46:0/3818050976 >> v2:172.21.15.73:3300/0 conn(0x7f86ac153c40 msgr2=0x7f86ac06ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:43.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.678+0000 7f86b0dce640 1 --2- 172.21.15.46:0/3818050976 >> v2:172.21.15.73:3300/0 conn(0x7f86ac153c40 0x7f86ac06ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.678+0000 7f86b0dce640 1 -- 172.21.15.46:0/3818050976 >> v1:172.21.15.73:6789/0 conn(0x7f86ac06f2d0 legacy=0x7f86ac0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.678+0000 7f86b0dce640 1 -- 172.21.15.46:0/3818050976 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac1598f0 con 0x7f86ac15d120 2024-01-27T15:00:43.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.680+0000 7f86b0dce640 1 --2- 172.21.15.46:0/3818050976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac15d550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009d90 tx=0x7f86a402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8420e01b0730f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:43.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.682+0000 7f86aaffd640 1 -- 172.21.15.46:0/3818050976 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a402cc50 con 0x7f86ac15d120 2024-01-27T15:00:43.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86aaffd640 1 -- 172.21.15.46:0/3818050976 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f86a402cdb0 con 0x7f86ac15d120 2024-01-27T15:00:43.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86aaffd640 1 -- 172.21.15.46:0/3818050976 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4034680 con 0x7f86ac15d120 2024-01-27T15:00:43.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 -- 172.21.15.46:0/3818050976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 msgr2=0x7f86ac15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 --2- 172.21.15.46:0/3818050976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac15d550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009d90 tx=0x7f86a402bea0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 -- 172.21.15.46:0/3818050976 shutdown_connections 2024-01-27T15:00:43.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 --2- 172.21.15.46:0/3818050976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac15d550 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 --2- 172.21.15.46:0/3818050976 >> v2:172.21.15.73:3300/0 conn(0x7f86ac153c40 0x7f86ac06ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 -- 172.21.15.46:0/3818050976 >> 172.21.15.46:0/3818050976 conn(0x7f86ac0cbf80 msgr2=0x7f86ac0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 -- 172.21.15.46:0/3818050976 shutdown_connections 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.685+0000 7f86b2831640 1 -- 172.21.15.46:0/3818050976 wait complete. 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.686+0000 7f86b2831640 1 Processor -- start 2024-01-27T15:00:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 -- start start 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86ac06f2d0 0x7f86ac158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac1efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac158e30 con 0x7f86ac153c40 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac1f3520 con 0x7f86ac06f2d0 2024-01-27T15:00:43.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.687+0000 7f86b2831640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac1590d0 con 0x7f86ac15d120 2024-01-27T15:00:43.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.688+0000 7f86ab7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.688+0000 7f86abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86ac06f2d0 0x7f86ac158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.688+0000 7f86ab7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60572/0 (socket says 172.21.15.46:60572) 2024-01-27T15:00:43.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.688+0000 7f86ab7fe640 1 -- 172.21.15.46:0/786688612 learned_addr learned my addr 172.21.15.46:0/786688612 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:43.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.689+0000 7f86b0dce640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac1efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.692+0000 7f86ab7fe640 1 -- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 msgr2=0x7f86ac1efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.692+0000 7f86ab7fe640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac1efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.692+0000 7f86ab7fe640 1 -- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86ac06f2d0 msgr2=0x7f86ac158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:43.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.692+0000 7f86ab7fe640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86ac06f2d0 0x7f86ac158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:43.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.692+0000 7f86ab7fe640 1 -- 172.21.15.46:0/786688612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009a70 con 0x7f86ac153c40 2024-01-27T15:00:43.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.695+0000 7f86ab7fe640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f869400c440 tx=0x7f8694001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.699+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694005ce0 con 0x7f86ac153c40 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.699+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8694005e40 con 0x7f86ac153c40 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.699+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694007310 con 0x7f86ac153c40 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.699+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac1ef510 con 0x7f86ac153c40 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.699+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac148750 con 0x7f86ac153c40 2024-01-27T15:00:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.700+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac0742e0 con 0x7f86ac153c40 2024-01-27T15:00:43.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.964+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f86940074f0 con 0x7f86ac153c40 2024-01-27T15:00:43.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.965+0000 7f86a8ff9640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 0x7f868c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:43.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.965+0000 7f86abfff640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 0x7f868c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:43.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.965+0000 7f86abfff640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 0x7f868c06d3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f869c009b40 tx=0x7f869c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:43.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.979+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6568+0+0 (secure 0 0 0) 0x7f8694057c00 con 0x7f86ac153c40 2024-01-27T15:00:43.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:43.979+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8694053f40 con 0x7f86ac153c40 2024-01-27T15:00:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.163+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86ac15dcc0 con 0x7f86ac153c40 2024-01-27T15:00:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.570+0000 7f86a8ff9640 1 -- 172.21.15.46:0/786688612 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8694017030 con 0x7f86ac153c40 2024-01-27T15:00:44.572 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-01-27T15:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.573+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 msgr2=0x7f868c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.573+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 0x7f868c06d3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f869c009b40 tx=0x7f869c009190 comp rx=0 tx=0).stop 2024-01-27T15:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.573+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 msgr2=0x7f86ac148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.573+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f869400c440 tx=0x7f8694001e70 comp rx=0 tx=0).stop 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 shutdown_connections 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f868c06af20 0x7f868c06d3e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86ac15d120 0x7f86ac1efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86ac153c40 0x7f86ac148210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 --2- 172.21.15.46:0/786688612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86ac06f2d0 0x7f86ac158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 >> 172.21.15.46:0/786688612 conn(0x7f86ac0cbf80 msgr2=0x7f86ac0c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 shutdown_connections 2024-01-27T15:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.574+0000 7f86b2831640 1 -- 172.21.15.46:0/786688612 wait complete. 2024-01-27T15:00:44.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-27T15:00:44.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.695+0000 7f7681456640 1 Processor -- start 2024-01-27T15:00:44.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.695+0000 7f7681456640 1 -- start start 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.696+0000 7f7681456640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f767c08b670 0x7f767c1651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.696+0000 7f7681456640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c0ca820 con 0x7f767c153b60 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.696+0000 7f7681456640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c15a7c0 con 0x7f767c15a3a0 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.696+0000 7f7681456640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0ca3d0 con 0x7f767c08b670 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.697+0000 7f767b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f767c08b670 0x7f767c1651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.697+0000 7f767a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f767c15a3a0 0x7f767c08af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.46:48912/0 (socket says 172.21.15.46:48912) 2024-01-27T15:00:44.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.697+0000 7f767a7fc640 1 -- 172.21.15.46:0/2255425362 learned_addr learned my addr 172.21.15.46:0/2255425362 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T15:00:44.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.699+0000 7f7679ffb640 1 -- 172.21.15.46:0/2255425362 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870134013 0 0) 0x7f767c15a7c0 con 0x7f767c15a3a0 2024-01-27T15:00:44.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.699+0000 7f7679ffb640 1 -- 172.21.15.46:0/2255425362 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7664003520 con 0x7f767c15a3a0 2024-01-27T15:00:44.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.700+0000 7f767b7fe640 1 -- 172.21.15.46:0/2255425362 >> v1:172.21.15.73:6789/0 conn(0x7f767c15a3a0 legacy=0x7f767c08af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.700+0000 7f767b7fe640 1 -- 172.21.15.46:0/2255425362 >> v1:172.21.15.46:6789/0 conn(0x7f767c153b60 legacy=0x7f767c0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T15:00:44.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.700+0000 7f767b7fe640 1 -- 172.21.15.46:0/2255425362 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0c9e10 con 0x7f767c08b670 2024-01-27T15:00:44.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.702+0000 7f767b7fe640 1 --2- 172.21.15.46:0/2255425362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c08b670 0x7f767c1651d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd18bc8ed1ebfd server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7679ffb640 1 -- 172.21.15.46:0/2255425362 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c02cc60 con 0x7f767c08b670 2024-01-27T15:00:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7679ffb640 1 -- 172.21.15.46:0/2255425362 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f766c02cdc0 con 0x7f767c08b670 2024-01-27T15:00:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7679ffb640 1 -- 172.21.15.46:0/2255425362 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c034680 con 0x7f767c08b670 2024-01-27T15:00:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 -- 172.21.15.46:0/2255425362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c08b670 msgr2=0x7f767c1651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 --2- 172.21.15.46:0/2255425362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c08b670 0x7f767c1651d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c02beb0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 -- 172.21.15.46:0/2255425362 shutdown_connections 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 --2- 172.21.15.46:0/2255425362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c08b670 0x7f767c1651d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 -- 172.21.15.46:0/2255425362 >> 172.21.15.46:0/2255425362 conn(0x7f767c071df0 msgr2=0x7f767c072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 -- 172.21.15.46:0/2255425362 shutdown_connections 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.707+0000 7f7681456640 1 -- 172.21.15.46:0/2255425362 wait complete. 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 Processor -- start 2024-01-27T15:00:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 -- start start 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f767c08b670 0x7f767c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c153b60 0x7f767c1ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c148bd0 con 0x7f767c15a3a0 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c147fa0 con 0x7f767c153b60 2024-01-27T15:00:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.709+0000 7f7681456640 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c147b10 con 0x7f767c08b670 2024-01-27T15:00:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.710+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.710+0000 7f767a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c153b60 0x7f767c1ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.710+0000 7f767affd640 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f767c08b670 0x7f767c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.710+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43216/0 (socket says 172.21.15.46:43216) 2024-01-27T15:00:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.710+0000 7f767b7fe640 1 -- 172.21.15.46:0/2162042777 learned_addr learned my addr 172.21.15.46:0/2162042777 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T15:00:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.714+0000 7f767b7fe640 1 -- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f767c08b670 msgr2=0x7f767c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.714+0000 7f767b7fe640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f767c08b670 0x7f767c14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.714+0000 7f767b7fe640 1 -- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c153b60 msgr2=0x7f767c1ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.714+0000 7f767b7fe640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c153b60 0x7f767c1ef700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.714+0000 7f767b7fe640 1 -- 172.21.15.46:0/2162042777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009a70 con 0x7f767c15a3a0 2024-01-27T15:00:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.716+0000 7f767b7fe640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.719+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c040650 con 0x7f767c15a3a0 2024-01-27T15:00:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.719+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f766c0407d0 con 0x7f767c15a3a0 2024-01-27T15:00:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.719+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c040ba0 con 0x7f767c15a3a0 2024-01-27T15:00:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.720+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c14c5b0 con 0x7f767c15a3a0 2024-01-27T15:00:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.720+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c1471e0 con 0x7f767c15a3a0 2024-01-27T15:00:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.721+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c153710 con 0x7f767c15a3a0 2024-01-27T15:00:44.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.984+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f766c040d00 con 0x7f767c15a3a0 2024-01-27T15:00:44.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.984+0000 7f76637fe640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 0x7f766806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T15:00:44.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.984+0000 7f767affd640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 0x7f766806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T15:00:44.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.985+0000 7f767affd640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 0x7f766806d410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7674004f60 tx=0x7f7674007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T15:00:44.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.997+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f766c07b5d0 con 0x7f767c15a3a0 2024-01-27T15:00:44.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:44.997+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f766c077910 con 0x7f767c15a3a0 2024-01-27T15:00:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.177+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f767c0b49c0 con 0x7f767c15a3a0 2024-01-27T15:00:45.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-27T15:00:45.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-27T15:00:45.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-27T15:00:45.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-27T15:00:45.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-01-27T15:00:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.702+0000 7f76637fe640 1 -- 172.21.15.46:0/2162042777 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f766c009450 con 0x7f767c15a3a0 2024-01-27T15:00:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' removed 2024-01-27T15:00:45.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 msgr2=0x7f766806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 0x7f766806d410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7674004f60 tx=0x7f7674007e30 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 msgr2=0x7f767c1efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c004a40 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 shutdown_connections 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:6800/82124097,v1:172.21.15.46:6801/82124097] conn(0x7f766806af50 0x7f766806d410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c153b60 0x7f767c1ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f767c15a3a0 0x7f767c1efc40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 --2- 172.21.15.46:0/2162042777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f767c08b670 0x7f767c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 >> 172.21.15.46:0/2162042777 conn(0x7f767c071df0 msgr2=0x7f767c0cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 shutdown_connections 2024-01-27T15:00:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T15:00:45.704+0000 7f7681456640 1 -- 172.21.15.46:0/2162042777 wait complete. 2024-01-27T15:00:45.718 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-27T15:00:45.718 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-27T15:00:45.718 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:45.718 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:00:45.718 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-01-27T15:00:45.719 INFO:tasks.ceph.mds.a:Stopped 2024-01-27T15:00:45.719 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-27T15:00:45.719 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:45.719 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:00:45.719 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-01-27T15:00:45.720 INFO:tasks.ceph.mds.c:Stopped 2024-01-27T15:00:45.720 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-27T15:00:45.720 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:45.739 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-01-27T15:00:45.723+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 42366) UID: 0 2024-01-27T15:00:45.740 INFO:tasks.ceph.mds.e.smithi046.stderr:2024-01-27T15:00:45.725+0000 b5cf640 -1 mds.e *** got signal Terminated *** 2024-01-27T15:00:51.341 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:49.798 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.346 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:49.803 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.353 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:29:49.760 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.354 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:29:49.761 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.356 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:29:49.763 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.358 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:29:49.765 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.437 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:49.894 36796== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.453 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:29:49.860 36340== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.456 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:29:49.863 36341== Warning: unimplemented fcntl command: 1036 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-27T15:00:51.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-27T15:00:51.822 INFO:tasks.ceph.mds.e:Stopped 2024-01-27T15:00:51.822 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-27T15:00:51.822 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:51.822 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:00:51.822 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-01-27T15:00:51.823 INFO:tasks.ceph.mds.b:Stopped 2024-01-27T15:00:51.823 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-27T15:00:51.823 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:51.823 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:00:51.823 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-01-27T15:00:51.823 INFO:tasks.ceph.mds.d:Stopped 2024-01-27T15:00:51.823 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-27T15:00:51.823 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:51.823 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:00:51.824 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-01-27T15:00:51.824 INFO:tasks.ceph.mds.f:Stopped 2024-01-27T15:00:51.824 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-27T15:00:51.824 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-27T15:00:51.824 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:51.825 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T15:00:51.822+0000 7fa936d9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37124) UID: 0 2024-01-27T15:00:51.825 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T15:00:51.822+0000 7fa936d9b640 -1 osd.0 34 *** Got signal Terminated *** 2024-01-27T15:00:57.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-27T15:00:57.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-27T15:00:57.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-27T15:00:57.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-01-27T15:00:57.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-01-27T15:00:57.926 INFO:tasks.ceph.osd.0:Stopped 2024-01-27T15:00:57.926 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-27T15:00:57.926 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:00:57.927 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T15:00:57.925+0000 7f71fe27e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37130) UID: 0 2024-01-27T15:00:57.927 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T15:00:57.925+0000 7f71fe27e640 -1 osd.1 35 *** Got signal Terminated *** 2024-01-27T15:01:03.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:01:03.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:01:03.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-27T15:01:03.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-27T15:01:04.028 INFO:tasks.ceph.osd.1:Stopped 2024-01-27T15:01:04.028 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-27T15:01:04.028 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:04.029 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T15:01:04.027+0000 7fa553a6d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37135) UID: 0 2024-01-27T15:01:04.030 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T15:01:04.027+0000 7fa553a6d640 -1 osd.2 37 *** Got signal Terminated *** 2024-01-27T15:01:09.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-27T15:01:09.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-27T15:01:10.130 INFO:tasks.ceph.osd.2:Stopped 2024-01-27T15:01:10.130 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-27T15:01:10.131 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:10.131 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T15:01:10.130+0000 7fcac345a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37139) UID: 0 2024-01-27T15:01:10.131 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T15:01:10.130+0000 7fcac345a640 -1 osd.3 38 *** Got signal Terminated *** 2024-01-27T15:01:15.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-27T15:01:15.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-27T15:01:16.232 INFO:tasks.ceph.osd.3:Stopped 2024-01-27T15:01:16.233 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-27T15:01:16.233 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:16.234 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T15:01:16.232+0000 7efc2bd43640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 36927) UID: 0 2024-01-27T15:01:16.234 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-01-27T15:01:16.232+0000 7efc2bd43640 -1 osd.4 39 *** Got signal Terminated *** 2024-01-27T15:01:21.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-27T15:01:21.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-27T15:01:22.335 INFO:tasks.ceph.osd.4:Stopped 2024-01-27T15:01:22.336 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-27T15:01:22.336 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:22.336 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T15:01:22.334+0000 7fd00f931640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 36929) UID: 0 2024-01-27T15:01:22.337 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-01-27T15:01:22.334+0000 7fd00f931640 -1 osd.5 40 *** Got signal Terminated *** 2024-01-27T15:01:27.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-27T15:01:27.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-27T15:01:28.437 INFO:tasks.ceph.osd.5:Stopped 2024-01-27T15:01:28.437 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-27T15:01:28.437 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:28.438 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T15:01:28.437+0000 7fc490934640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 36931) UID: 0 2024-01-27T15:01:28.438 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-01-27T15:01:28.437+0000 7fc490934640 -1 osd.6 41 *** Got signal Terminated *** 2024-01-27T15:01:32.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-27T15:01:32.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-27T15:01:33.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:01:33.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:01:34.539 INFO:tasks.ceph.osd.6:Stopped 2024-01-27T15:01:34.539 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-27T15:01:34.539 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:34.540 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T15:01:34.539+0000 7ff9cb943640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 36933) UID: 0 2024-01-27T15:01:34.540 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-01-27T15:01:34.539+0000 7ff9cb943640 -1 osd.7 41 *** Got signal Terminated *** 2024-01-27T15:01:38.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-27T15:01:38.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-27T15:01:40.640 INFO:tasks.ceph.osd.7:Stopped 2024-01-27T15:01:40.640 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-27T15:01:40.640 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-27T15:01:40.641 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:40.668 INFO:tasks.ceph.mgr.y:Stopped 2024-01-27T15:01:40.668 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-27T15:01:40.668 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:40.694 INFO:tasks.ceph.mgr.x:Stopped 2024-01-27T15:01:40.694 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-27T15:01:40.694 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-27T15:01:40.694 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:40.731 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-27T15:01:40.712+0000 9f79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36766) UID: 0 2024-01-27T15:01:40.731 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-27T15:01:40.714+0000 9f79640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-27T15:01:41.352 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:30:39.809 36796== 2024-01-27T15:01:41.352 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:30:39.809 36796== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:01:41.365 INFO:tasks.ceph.mon.a.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:01:43.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-27T15:01:43.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-27T15:01:46.796 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:01:46.796 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-01-27T15:01:46.797 INFO:tasks.ceph.mon.a:Stopped 2024-01-27T15:01:46.797 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-27T15:01:46.797 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:46.814 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-01-27T15:01:46.799+0000 9f79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 36334) UID: 0 2024-01-27T15:01:46.815 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-01-27T15:01:46.801+0000 9f79640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-01-27T15:01:47.304 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:30:45.711 36340== 2024-01-27T15:01:47.304 INFO:tasks.ceph.mon.b.smithi073.stderr:==00:00:30:45.711 36340== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:01:47.314 INFO:tasks.ceph.mon.b.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:01:48.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-27T15:01:48.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-27T15:01:52.899 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:01:52.899 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-01-27T15:01:52.899 INFO:tasks.ceph.mon.b:Stopped 2024-01-27T15:01:52.900 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-27T15:01:52.900 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T15:01:52.916 INFO:tasks.ceph.mon.c.smithi073.stderr:2024-01-27T15:01:52.902+0000 9f79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 36336) UID: 0 2024-01-27T15:01:52.916 INFO:tasks.ceph.mon.c.smithi073.stderr:2024-01-27T15:01:52.904+0000 9f79640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-01-27T15:01:53.437 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:30:51.844 36341== 2024-01-27T15:01:53.438 INFO:tasks.ceph.mon.c.smithi073.stderr:==00:00:30:51.844 36341== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T15:01:53.448 INFO:tasks.ceph.mon.c.smithi073.stderr:daemon-helper: command failed with exit status 42 2024-01-27T15:01:53.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-27T15:01:53.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-27T15:01:58.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2024-01-27T15:01:59.002 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T15:01:59.002 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-01-27T15:01:59.002 INFO:tasks.ceph.mon.c:Stopped 2024-01-27T15:01:59.002 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-27T15:01:59.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-27T15:01:59.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T15:01:59.041 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-27T15:01:59.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T15:01:59.151 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-27T15:01:59.217 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T15:01:59.218 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-27T15:01:59.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T15:01:59.284 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-27T15:01:59.362 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T15:01:59.362 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-27T15:01:59.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T15:01:59.485 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-27T15:01:59.551 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T15:01:59.551 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-27T15:01:59.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T15:01:59.607 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-27T15:01:59.691 INFO:tasks.ceph:Archiving mon data... 2024-01-27T15:01:59.692 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/data/mon.a.tgz 2024-01-27T15:01:59.692 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-27T15:01:59.709 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.OlqsdSzzxK 2024-01-27T15:01:59.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OlqsdSzzxK 2024-01-27T15:01:59.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.OlqsdSzzxK 2024-01-27T15:01:59.963 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.OlqsdSzzxK is 304KB 2024-01-27T15:02:00.059 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.OlqsdSzzxK 2024-01-27T15:02:00.076 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/data/mon.b.tgz 2024-01-27T15:02:00.076 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-01-27T15:02:00.094 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.jdnCyeq83K 2024-01-27T15:02:00.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jdnCyeq83K 2024-01-27T15:02:00.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.jdnCyeq83K 2024-01-27T15:02:00.319 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.jdnCyeq83K is 312KB 2024-01-27T15:02:00.414 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.jdnCyeq83K 2024-01-27T15:02:00.428 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/data/mon.c.tgz 2024-01-27T15:02:00.429 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-01-27T15:02:00.485 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Y2YESEnQ4v 2024-01-27T15:02:00.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Y2YESEnQ4v 2024-01-27T15:02:00.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Y2YESEnQ4v 2024-01-27T15:02:00.694 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Y2YESEnQ4v is 312KB 2024-01-27T15:02:00.790 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Y2YESEnQ4v 2024-01-27T15:02:00.804 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-27T15:02:00.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-27T15:02:00.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-27T15:02:01.130 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T15:02:01.372 INFO:tasks.ceph:Archiving crash dumps... 2024-01-27T15:02:01.374 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi046/crash 2024-01-27T15:02:01.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-27T15:02:01.405 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi073/crash 2024-01-27T15:02:01.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-27T15:02:01.432 INFO:tasks.ceph:Shutting down logrotate 2024-01-27T15:02:01.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:02:01.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T15:02:01.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-27T15:02:01.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-27T15:02:01.583 INFO:tasks.ceph:Compressing logs... 2024-01-27T15:02:01.584 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-27T15:02:01.588 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-27T15:02:01.614 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-01-27T15:02:01.614 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mds.f.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36665.log 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr: 69.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-01-27T15:02:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36534.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36665.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36665.log.gz 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36534.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip 86.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36534.log.gz -- 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-osd.4.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36584.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36584.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:gzip 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.7.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36584.log.gz 2024-01-27T15:02:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36625.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36625.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.f.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36625.log.gz 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36705.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-27T15:02:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-27T15:02:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-27T15:02:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2024-01-27T15:02:01.691 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50425.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz -5 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46132.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43399.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43399.log.gz 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44988.log 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49724.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz --verbose 2024-01-27T15:02:01.692 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.42725.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44988.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30779.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44988.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.42725.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.30779.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.30779.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.49892.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1%/var/log/ceph/ceph-client.admin.49892.log: -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45594.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51260.log: /var/log/ceph/ceph-client.admin.45594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2024-01-27T15:02:01.693 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45594.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46384.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-01-27T15:02:01.694 INFO:teuthology.orchestra.run.smithi046.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50341.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.e.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43247.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42977.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50341.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45030.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43247.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42977.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45030.log.gz 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42500.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42935.log: gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.46426.log 2024-01-27T15:02:01.695 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50949.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42500.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50467.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50949.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43121.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37144.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50467.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43121.log.gz 2024-01-27T15:02:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51133.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37144.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43163.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50845.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51133.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43163.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49522.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43205.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50845.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49522.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49522.log.gz 2024-01-27T15:02:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50257.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46030.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50257.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50257.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46342.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46030.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44268.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-01-27T15:02:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50677.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44268.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42893.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45661.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45661.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45661.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44142.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45660.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-01-27T15:02:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45660.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44142.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51302.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45660.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46720.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51218.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45337.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37259.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51218.log.gz 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-01-27T15:02:01.700 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45337.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47110.log: /var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44100.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46000.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45346.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44100.log.gz 2024-01-27T15:02:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45722.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45346.log.gz 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50035.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50215.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50035.log.gz 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46300.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gzgzip 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz -5 --verbose 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.42641.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50215.log: /var/log/ceph/ceph-client.admin.50803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45561.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50215.log.gz 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42641.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44494.log 2024-01-27T15:02:01.702 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2%/var/log/ceph/ceph-client.admin.45561.log: -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45561.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43019.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44494.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44494.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51009.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42809.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43019.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51386.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49582.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51009.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49582.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51386.log.gz 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-01-27T15:02:01.703 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49582.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45342.log: -- /var/log/ceph/ceph-client.admin.45900.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46678.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45900.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46762.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45900.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45880.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49438.log 2024-01-27T15:02:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45880.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45072.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36805.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43332.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45072.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43289.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43289.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43332.log.gz 2024-01-27T15:02:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49624.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45601.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49624.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.45601.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49766.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49624.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46258.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49766.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-01-27T15:02:01.706 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49766.log.gz/var/log/ceph/ceph-client.admin.46258.log: 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.e.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46258.log.gz 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42595.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44326.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6%/var/log/ceph/ceph-client.admin.42595.log: -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44946.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42595.log.gz 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44326.log.gz 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-01-27T15:02:01.707 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44946.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44536.log: /var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51049.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42256.log: 87.8% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51049.log: /var/log/ceph/ceph-client.admin.42683.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50509.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51049.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50299.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.42683.log.gz 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50551.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51344.log 2024-01-27T15:02:01.708 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50299.log: /var/log/ceph/ceph-client.admin.50551.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50299.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50551.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51091.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49850.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51344.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51091.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51091.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45664.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2024-01-27T15:02:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45937.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50888.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50888.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46846.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46060.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2024-01-27T15:02:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46912.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44794.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44794.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44614.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43079.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50119.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42767.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50119.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50119.log.gz 2024-01-27T15:02:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45334.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50719.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45334.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45334.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46174.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50162.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49480.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49480.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49480.log.gz 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47624.log 2024-01-27T15:02:01.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46636.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-01-27T15:02:01.713 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50383.log 2024-01-27T15:02:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.47624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44878.log 2024-01-27T15:02:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50383.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50383.log.gz 2024-01-27T15:02:01.714 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-01-27T15:02:01.715 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44878.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44878.log.gz 2024-01-27T15:02:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36836.log 2024-01-27T15:02:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36785.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2024-01-27T15:02:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-27T15:02:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36836.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36836.log.gz 2024-01-27T15:02:01.717 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-27T15:02:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50635.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-01-27T15:02:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-27T15:02:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42170.log 2024-01-27T15:02:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-27T15:02:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-01-27T15:02:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42170.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gz 2024-01-27T15:02:01.741 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46552.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-01-27T15:02:01.752 INFO:teuthology.orchestra.run.smithi073.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-27T15:02:01.821 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-27T15:02:01.930 INFO:teuthology.orchestra.run.smithi046.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-27T15:02:02.253 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-27T15:02:02.296 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-27T15:02:02.996 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-27T15:02:03.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-27T15:02:04.488 INFO:teuthology.orchestra.run.smithi073.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-27T15:02:04.491 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-27T15:02:04.937 INFO:teuthology.orchestra.run.smithi046.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-27T15:02:05.096 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-27T15:02:05.564 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-27T15:02:05.776 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-27T15:02:05.838 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-27T15:02:06.035 INFO:teuthology.orchestra.run.smithi073.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-27T15:02:14.637 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.47624.log.gz 2024-01-27T15:02:14.637 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T15:02:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m13.035s 2024-01-27T15:02:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m28.233s 2024-01-27T15:02:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.912s 2024-01-27T15:02:20.924 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-01-27T15:02:20.926 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-01-27T15:02:20.926 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m19.284s 2024-01-27T15:02:20.926 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m34.258s 2024-01-27T15:02:20.926 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.073s 2024-01-27T15:02:20.926 INFO:tasks.ceph:Archiving logs... 2024-01-27T15:02:20.926 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi046/log 2024-01-27T15:02:20.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-27T15:02:25.167 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi073/log 2024-01-27T15:02:25.168 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-27T15:02:30.304 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T15:02:30.305 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-27T15:02:30.315 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T15:02:30.315 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-27T15:02:30.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-27T15:02:30.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-27T15:02:30.408 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-27T15:02:30.417 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-27T15:02:30.417 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T15:02:30.420 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T15:02:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-01-27T15:02:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-01-27T15:02:30.438 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 +799us[ +799us] +/- 88ms 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 +890us[ +892us] +/- 65ms 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -1647us[-1647us] +/- 79ms 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T15:02:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-01-27T15:02:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +793us[ +798us] +/- 88ms 2024-01-27T15:02:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 +892us[ +898us] +/- 65ms 2024-01-27T15:02:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -1647us[-1647us] +/- 79ms 2024-01-27T15:02:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T15:02:30.441 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-27T15:02:30.450 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-27T15:02:30.451 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-27T15:02:30.460 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-27T15:02:30.560 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-27T15:02:30.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T15:02:30.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T15:02:30.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T15:02:30.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T15:02:30.693 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-27T15:02:30.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-27T15:02:30.712 INFO:teuthology.task.internal:Duration was 2684.413220 seconds 2024-01-27T15:02:30.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-27T15:02:30.722 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-27T15:02:30.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-27T15:02:30.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-27T15:02:30.767 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T15:02:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T15:02:31.061 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-27T15:02:31.061 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T15:02:31.062 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-27T15:02:31.081 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-01-27T15:02:31.082 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-27T15:02:31.107 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-27T15:02:31.107 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-27T15:02:31.124 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-27T15:02:31.177 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-27T15:02:31.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-27T15:02:31.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-27T15:02:31.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-27T15:02:31.339 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-27T15:02:31.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-27T15:02:31.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-27T15:02:31.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-27T15:02:31.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-27T15:02:31.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-27T15:02:31.430 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-01-27T15:02:31.457 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-01-27T15:02:31.482 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-27T15:02:31.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T15:02:31.500 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-27T15:02:31.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T15:02:31.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-27T15:02:31.546 INFO:teuthology.task.internal:Transferring archived files... 2024-01-27T15:02:31.547 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi046 2024-01-27T15:02:31.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-27T15:02:31.584 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528/remote/smithi073 2024-01-27T15:02:31.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-27T15:02:31.623 INFO:teuthology.task.internal:Removing archive directory... 2024-01-27T15:02:31.623 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-27T15:02:31.626 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-27T15:02:31.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-27T15:02:31.683 INFO:teuthology.task.internal:Not uploading archives. 2024-01-27T15:02:31.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-27T15:02:31.693 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-27T15:02:31.694 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-27T15:02:31.696 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-27T15:02:31.708 INFO:teuthology.orchestra.run.smithi046.stdout: 265291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 27 15:02 /home/ubuntu/cephtest 2024-01-27T15:02:31.726 INFO:teuthology.orchestra.run.smithi073.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 27 15:02 /home/ubuntu/cephtest 2024-01-27T15:02:31.727 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-27T15:02:31.737 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-27T15:02:31.750 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T15:02:31.750 INFO:teuthology.nuke:Checking targets against current locks 2024-01-27T15:02:31.777 DEBUG:teuthology.nuke:shortname: smithi046 2024-01-27T15:02:31.778 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T15:02:31.802 DEBUG:teuthology.nuke:shortname: smithi073 2024-01-27T15:02:31.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T15:02:31.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:09:19.252140', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu/zqIZRBFg3jp2A+Ufv+qjoMhSjPz03v7LvvtAVKnmEO2mjp7B1iuDNtezGLOzuLi6c/O9wg94epW1vuIk0f8='} 2024-01-27T15:02:31.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:09:19.250730', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdEBJQmefarsjgSOccQldjMza8K92XAI0BWDP44GlKV+4iAQNyG015M92vcgO5zbF4gOApWiYROHiqIfxZy17w='} 2024-01-27T15:02:31.863 INFO:teuthology.orchestra.console.smithi046:Power off 2024-01-27T15:02:31.863 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T15:02:31.888 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-01-27T15:02:31.888 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:31.904 INFO:teuthology.orchestra.console.smithi073:Power off 2024-01-27T15:02:31.904 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T15:02:31.915 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-27T15:02:31.926 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-01-27T15:02:31.926 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:31.950 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-27T15:02:35.916 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:35.951 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:36.026 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-27T15:02:36.059 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-27T15:02:40.028 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:40.060 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:40.138 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-27T15:02:40.174 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-27T15:02:40.240 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-01-27T15:02:44.175 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T15:02:44.285 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-01-27T15:02:44.387 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-01-27T15:02:44.492 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 2684.41322016716 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-01-27T15:02:44.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T15:02:44.582 INFO:teuthology.run:FAIL